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[57] ABSTRACT 

An electronic method and apparatus for signal encoding and 
decoding to provide idtra low distortion reproduction of 
analog signals, while remaining compatible with industry 
standardized signal playback apparatus not incorporating the 
decoding features of the invention, and wherein the 
improved system provides an interplay of gain, slew rate and 
wave synthesis operations to reduce signal distortions and 
improve apparent resolution, all under the control of con- 
cealed control codes for triggering appropriate decoding 
signal reconstruction compensation complementing the sig- 
nal analysis made during encoding. In addition, signals 
lacking the encoding process features of the invention are 
likewise compatible with playback decoders which do 
embody the invention, to provide some overall restoration 
enhancement. 

20 Claims, 20 Drawing Sheets 
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SIGNAL ENCODE/DECODE SYSTEM 

This is a continuation, of application Ser. No. 08/455, 
350, filed May 31, 1995 now abandoned, which is a divi- 
sional of U.S. continuation patent appHcation Ser No. 5 
08/110335 filed Aug. 20, 1993, now U.S. Pat. No. 5,479,168 
issued Dec. 26, 1995, which is a continuation patent appli- 
cation Ser No. of 07/957,631 filed Oct. 6, 1992, now 
abandoned, which is a continuation patent application Ser. 
No. of 07/707,073 filed May 29, 1991, now abandoned. lo 

BACKGROUND OF THE INVENTION 

This invention relates generally to improvements in signal 
encoding/decoding methods and apparatus and, more 
particularly, to a new and improved digital encoding and 
decoding system for lower distortion, higher resolution, and 
increased dynamic range reproduction of analog signals 
while remaining compatible with industry standardized sig- 
-*^'nal playback apparatus and standards not incorporating the 
decoding features of the present invention. In addition, 
recordings lacking the encoding process features of the 
invention are likewise compatible with playback decoders 
which do embody the invention, and are provided some 
enhancement. 

25 

Quite often a recording or communications system is 
standardized and its format cannot be readily altered without 
affecting a substantial quantity of equipment already in 
existence. Hence, adding infonnation with supplemental 
codes may not always be practical unless provisions have 
been standardized for such insertions. Unfortunately, mod- 
em digital systems are not very expandable since data 
bandwidth, resolution, error correction, synchronization, 
ancillary data and other "housekeeping" information essen- 
tially occupy the entire digital capacity of the storage or 
transmission medium. 

However, electronic equipment manufacturers and users 
of such devices continue to seek enhanced performance and 
more features from such standardized systems. An important 
example is the need to make a compatible recording weU 
suited simultaneously for portable, automotive, television 
and audiophile markets. Today, many recordings are made 
for the most profitable market while other users sufifer 
compromised sonics. The obvious conflicting performance 
requirements of different listening environments and the 
need for sonic improvement should desirably be imple- 
mented by a new system which is compatible with older 
systems and recordings. 

Automobile and portable equipment are usually low cost 
and must operate in noisy environments. Hence, ia such 50 
situations, a slightly restricted dynamic range playback is 
beneficial. Audiophile systems require utmost accuracy, 
dynamic range, and resolution beyond that which is avail- 
able in the current standards. Thus, in any new compatible 
system, as provided by the present invention, encoded 55 
dynamics and slew rate modifications which achieve lowest 
distortion and best resolution for the audiophile when 
decoded, should also provide improved sonics for portable 
and automotive playback when not decoded. 

Compact Disc pulse code modulation and other digital 60 
audio encoding schemes are good examples of highly devel- 
oped and standardized systems which push signal condition- 
ing and digital information limits. Most such digital systems 
originally evolved around then practical 2.5 to 3.5 mHz 
rotary head video recorder bandwidths. In such standards, 65 
the data bits with error correction and housekeeping entirely 
fin the available bandwidth. Accordingly, the need for a 



35 



"smart" optimization technique, which does not rely upon 
increased bandwidth for its implementation, becomes appar- 
ent. 

By way of background, let us consider a typical digital 
audio record-play system, its most frequendy encountered 
components, operation, and diflScolties. In its simplest form, 
the recorder includes a sampling switch and an analog lo 
digital converter. The switch breaks the continuous analog 
signal into a series of voltage steps, each of which is 
converted to number groups or digital words. Digital level 
meters and simple communication systems often operate 
with just these functions in a single IC chip. Practical high 
performance record and playback systems require many 
added operations to prevent undesired internal and external 
analog-digital signal interactions, as well as beats and non- 
linear feedthrough between digital and analog frequencies. 
WeU-known technologies to deal with these problems 
include sharp cut-off or "brick wall" low-pass filters, fast 
sample and hold circuits, and high common mode rejection 
amplifiers. Unfortunately, although these components and 
subsystems solve many problems, they also create others. 

Briefly, in typical digital recording systems, low-pass 
fihers ring, and if of analog construction, have pre -echo, are 
subject to sudden phase shifts near band edge, and have 
capacitors which often cause troublesome dielectric hyster- 
esis effects. Sample and hold circuits have unpredictable 
timing and capture errors for different signal slew rates and 
also suffer from capacitor problems. Fast digital signals and 
the high speed amplifiers needed to handle them often create 
and are sensitive to ground currents which can cause audible 
strobe-beat effects. Digital reproducing systems have similar 
problems, along with spike or glitch generation caused by 
digital to analog conversion, and digital filter word length 
round off problems. Usually the recorder is designed to have 
state of the art performance while that of the reproducer 
degrades depending 00 the economies of "consumer" con- 
struction. Tliese and other problems continue to plague 
modern high performance digital audio systems. 

Unfortunately, such technical dtfficidties usually create 
jarring non-harmonic distortions, typically centered in the 
most sensitive and perceptive human hearing range. Often 
these distortions are caused by the highest, almost inaudible 
frequencies contained within the program material. Taking 
the ratio of high and low frequency hearing acuity into 
account, and the fact that sounds unrelated to the program 
material stand out, the presence of even an extraordinarily 
small amount of these distortions can be quite objectionable 
to the listener. Fortunately, often only very small corrections 
are needed to minimize some of these distortions. However, 
left as is, these distortion errors can combine to yield the 
equivalent of 13 to 14 bit performance accuracy from 
systems originally designed for 16 bit resolution. In practice, 
while some feel the advantages of current digital recordings 
outweigh the disadvantages of their distortion errors, many 
sophisticated listeners and audiophiles are not so tolerant. 

Accordingly, those concerned with the development and 
use of digital signal encoding and decoding systems for 
analog signals have long recognized the need for a higher 
quahty, lower distortion digital system for reproduction of 
such analog signals, which for all practical purposes is also 
compatible with existing equipment standards. The present 
invention fulfills all of these needs. 

SUMMARY OF THE INVENTION 

Briefly, and in general terms, the present invention pro- 
vides new and improved digital encoding/decoding methods 
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and apparatus for ultra low distortion reproductioa of analog 
signals which are also compatible with industry standardized 
signal playback apparatus not incorporating the decoding 
features of the present invention. In addition, signals lacking 
the encoding process features of the invention are likewise 5 
compatible with playback decoders which do embody the 
invention, and are provided some overall enhancement. 

Basically, the present invention is directed to various 
aspects of an improved encode/decode system for providing 
a predetermined balance or interplay of gain structiu:es, filter 
characteristics, various slew rate modifications, and wave 
synthesis operations to reduce signal distortions and 
improve apparent resolution. During the encoding process, 
an analysis of the signal to be encoded is made over time and 
the results of this analysis are subsequently utilized in the 
encoding and decoding process to more accurately recon- 
struct the original waveform upon playback. This is accom- 
plished while minimizing the deleterious effects normally 
encountered in sampling and converting analog signals to 
digital signals and subsequently reconverting the digital 20 
signals back to an accurate simulation of the original analog 
waveform. 

In accordance with the invention, control information 
developed during the aforedescribed waveform analysis is 
concealed within a standard digital code and this informa- 25 
tion is subsequently used to dynamically change and control 
the reproduction process for best performance. These con- 
cealed control codes trigger appropriate decoding signal 
reconstruction compensation complementing the encoding 
process selected as a result of the aforementioned signal 30 
analysis. Since the control code is silent and the overall 
digital information rate is normally fixed, the process can 
operate compatibly with existing equipment and industry 
standards. In addition, and as previously indicated, signals 
lacking the encoding process features of the invention are 35 
likewise compatible with playback decoders which do 
embody the invention, to provide some beneficial enhance- 
ment. 

To achieve higher performance with a fixed information 
rate, an on-going trade-off is made between dynamic range, 40 
to achieve improved smaU signal resolution, and peak level 
and/or slew rate, to achieve fast signal response accuracy. 
These small change and fast change aspects of a signal, as 
well as large and small amplitude aspects, each have their 
own digital distortion or system compromise mechanisms. 45 
Since both large and small aspects will not occur at the same 
time, an optimum encoding process or mix of processes 
favoring each signal condition can be chosen dynamically, in 
accordance with the invention, to achieve an improved 
signal reproduction within a fixed digital information rate. A 50 
silent or hidden control code documents these changes fi:om 
time to time in the signal encoding process and is used to 
create the complementary level, slew rate, filter character, 
and waveform synthesis necessary to restore the original 
signal during the decoding process. 55 

In a presently preferred embodiment of the invention, the 
encoder system has much higher resolution and speed than 
the industry standard or encoded product, and is set up as an 
acquisition system with sufficient look forward and look 
behind memory to compute the optimum processing of the 60 
signal and its corresponding reconstruction control code. As 
previously noted, the processing of the signal is determined 
based on a consideration of which trade-ofik of resolution, 
speed, and level are most appropriate for the signal condi- 
tions over time and how the reproducer can best be pro- 65 
grammed to allow the most accurate reproduction of the 
original analog signal. 
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To be inaudible, the computed reconstruction control 
signal is encoded or encrypted to a random number sequence 
which may be inserted continuously or dynamically when 
needed into the least significant digital bit or bits. The 
processed audio or signal becomes encoded to the remaining 
bits. 

Conventional decoding by a simple digital to analog 
converter of all bits of a recording encoded in accordance 
with the invention, yields a signal with slightly less dynamic 
range and otily slightly higher background noise. However, 
the signal will have lower quantization and slew induced 
distortions and, hence, the processed encoded product, when 
reproduced on non-decoding standard equipment, will sound 
equal to or better than an imencoded product. 

A fully decoding player, in accordance with the invention, 
retrieves the control signal and uses it to set up, operate and 
dynamically change a complementary process to recover the 
pre -computed high accuracy information and provide low 
distortion reproduction of the original analog signal. Opera- 
tions to do this include fast peak expansion, averaged low 
level gain reductions, selecting complementary interpolation 
filters, waveform synthesis, and others. When these are 
selected according to ongoing trade-offs, optimum for a 
particular set of signal conditions, an apparent increase of 
bandwidth and resolution occurs. 

An improved digital system, in accordance with the 
invention, uses groups of dynamically changing pre- 
determined performance trade -offe made when signal con- 
ditions of the recorded program would create distortion. 
Since digital distortions occur at extremes of high level, slew 
rate, and high frequencies, on one hand, and with quiet 
signals and short small transients on the other hand, a best 
encode/decode strategy is chosen for that extreme without 
the process compromise hurting the opposite aspects of the 
program. To achieve this, the program is delayed long 
enough so that a most likely distortion mechanism is iden- 
tified prior to its emergence from the time delay, thereby 
allowing a best encoding strategy and complementary 
decoding method to be determined and encoded. Perfor- 
mance is improved because any distortion compromise 
made occurs for opposite signal conditions, which are essen- 
tially nonexistent at that time. 

In the simplest form of the system, an encoded dynamic 
range compression and complementary reproduce expansion 
will improve performance. Furthermore, improvements are 
had by using averaged levels of small signals independent of 
their lower frequency and near supersonic frequency spec- 
tral components to control processing providing improved 
complementary restored resolution. In a similar manner, the 
strongest signals receive processing having DC to maximum 
bandwidth for instantaneous peak conditions, which also 
yields best complementary restoration. Only one correction 
need operate at a time and, hence, digital information is 
saved, or conversely, more apparent performance is obtained 
from an unchanged digital information rate. 

In addition, a further reduction of known and predictable 
digital distortions occurs by selecting a best low pass filter 
with the least compromise for program conditions during 
encoding and using a complementary interpolation or low 
pass filter during reproduction. Also, other improvements 
are had from the reduction of known recurrent distortions, 
such as transient errors, by synthesizing these components 
from lookup table curves of these distortions or missing 
information, and then scaling these to the signal at hand. 

All of the aforedescribed improvements can also operate 
with varying degrees of success in a default or "open loop" 
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mode at the reproducer by detecting information about the 
encoded signal and then varying these processes from the 
detected signal. 

Digital systems typically have a very high signal to noise 
ratio, but have a restricted working dynamic range of levels 
and restricted frequency response. The improved system of 
the present invention reduces distortions and, as such, uses 
signal character dependent gain changes, filter optimization, 
slew rate processing, and waveform reconstruction or syn- 
thesis to do this. The improved system computes, within 
memory and process time limits, a continuously changing 
best compromise strategy of available processes to give the 
best signal reconstruction. This obviously complex task 
yields a restoration control signal silently encrypted or noise 
disguised in a least significant bit code. By comparison, the 
reproducer system is simple, since its decoding and comple- 
mentary signal restoration can occur with conventional 
multiplying converters, digital signal processors and other 
analog and digital devices similar to or already used in 
consumer electronics. 

A conventional recording and reproducing digital system 
appears relatively simple and potentially accurate for all the 
data bits encoded. In practice, however, using a very near to 
theoretical minimum sampUng rate and the least acceptable 
number of data bits substantially aggravates speed and 
accuracy limitations from even the best state-of-the-art 
circuits and components. In this regard, the worst offenders 
are items such as filters, sample and hold circuits, analog- 
to-digital converters, digital-to-analog converters, and sys- 
tem grounding, timing and various process interactions and 
crosstalk. 

The aforedescribed practical technological difficulties and 
their potential distortions can be greatly minimized by using 
higher sampling rates and more data bits than current 
standards allow. In fact, current technological capability 
permits the reduction of cross-talk, time jitter and other 
noise interaction problems which, along with digital band- 
width limitations, prevented the practical implementation of 
higher data rates when current digital standards were first 
envisioned and established. With today's high speed con- 
verters operating much faster with more data bits, filters can 
become less severe and the greater dififereoce between 
highest audio frequencies and the digital sampling rate then 
reduces beats, sideband foldovers, aliasing, as well as loss of 
small signal information. The present invention uses these 
capabilities by employing a high speed conversion process. 
The digital information rate, though now much higher, can 
be computed, as an ongoing acquisition process, to an "error 
free" mathematicaUy filtered lower sampling rate 16 bit code 
compatible with current standards. Most decimation over- 
samphng encoders work like this. However, in addition, the 
invention anticipates alias, aperture, interpolation and 
amplitude resolution distortions from an "ideal" standard 
reproducer and computes them during the encoding process 
for correction during reproduction. When the full process of 
the invention is used, even certain frequencies above the 
audio range or Nyquist limit of industry standard equipment 
can be sent through the system without creating sub- 
harmonic or foldover distortions. Hence, a closer to perfect 
record/playback system is provided with minimal problems 
from filters, converters, and other components or subsystems 
while remaining compatible with industry standards. 

For a Compact Disc system, "perfect" reproduction to 16 
bit industry standards will have a maximum of 65,536 well 
defined equally ^aced resolution steps, each about 150 
microvolts in amphtude when scaled to normal professional 
audio levels (10 volts peak-to-peak maximum). This 



number, when stepped consecutively at the industry standard 
44. 1 kHz sampHng rate, provides a slew of less than 7 volts 
per second. Faster rates will skip numbers until, for a 10 kHz 
triangle segment, only 2.2 sample points remain to define 
that waveshape as it would be filtered to its 20 kHz band- 
width. In this regard, more than a 1 giga Hertz sample rate 
would be required to include all 65,536 resolution points to 
create that wave segment. Fortunately, an ideal interpolation 
filter will fill in all of these points provided the 2,2 samples 
have been timed accurately enough. To do this to achieve a 
one half bit RMS averaged accurate sample of a fast 
changing signal the sample timing must occur within: 



20 



35 



50 



50 mScc 
10 Volt 



X pico second (RMS) 
ppl50uVo\V4sgrt(Z) 



jr=375xl0-^^/2 sqrt(2)=133 pico sec. 

This sample, accurate in time and amplitude, must be held 
long enough for conversion to digital code. Usually, a charge 
on a capacitor represents this information. However, most 
dielectrics and insulators used to fabricate capacitors have 
complex losses as well as past history memory which create 
a complex delayed voltage change, field re-distribution 
enors and leakage. When abrupt changes in level from 
sample to sample occur, as they do with sampled high 
firequency audio signals, these errors often become much 
greater than when signal levels don't change. To have less 
than a half LSB of RMS averaged error the hold accuracy 
becomes: 



ISO u VoWLSB X 44.1 kHz 
2 X sqrt{2) 



• 2.3 volt/sec 



65 



or about 2.3 u Volt per u sec. 

Such performance is well beyond simple apphcations of 
most modern electrical passive components, much less 
integrated circuits. Obviously, practical consumer playback 
equipment will not do better, and the resulting errors can 
produce slew rate related transient intermodulation distor- 
tion components, which are among the most audibly objec- 
tionable. Specifically, these result from acquisition time 
uncertainty or jitter, slew rate related non-linear switching 
oflkets, various types of dielectric hysteresis causing previ- 
ous event related errors, polarity dependent sample 
discrepancies, and unpredictable hysteresis within convert- 
ers as well as other factors. Thus, practical systems often 
have complex signal related errors as high as twenty times 
more than theoretical resolution limits of the current 16 bit 
standard. Hence, a process providing more sample points per 
second with the least voltage change per sample will yield 
a signal with lower transient intermodulation distortion. 

A second distortion mechanism occurs with very small 
signal amphtude changes of about 5 to 20 millivolts repre- 
sented by digital activities of less than about 8 bits in a 
typical 16 bit system. These levels seldom occur by them- 
selves yet can still be a small but audible part of a larger low 
firequency dominated signal. Hence, these small signals can 
occur averaged at many different voltage levels or digital 
numbers of a larger slow waveform. A practical example of 
this would be midband hall reverberation decay and bass 
sounds combined. The reverberation signal attenuates and 
sometimes completely disappears as it becomes chopped or 
broken segment parts of the bass waveform. As previously 
indicated, these breaks represent the 150 uV resolution 
Umits of a "perfecr 16 bit reproducer. In practice, very small 
signal changes can become stepped outputs, or more often 
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distort to irregular step to step changes with an uncertainty 
or hysteresis which occurs due to errors within converters 
and from external interference and crosstalk. This produces 
a collapse of the sense of space in a recording and generates 
impulsive grainy noise effects which are usually made less 
objectionable by adding a random noise voltage to the signal 
prior to encoding so that the step errors become randomized 
from the uncertain samples created. Thus, the stepped or 
quantized distortion becomes a less objectionable noise 
modulation and the least bit signal cut-off levels are now 
smoothed to a gradual gain loss with progressively smaller 
signal changes. A better form of distortion reduction occurs 
by increasing the sample points per unit voltage change. 
Unfortunately, like the process to increase slew accuracy, a 
much higher digital information rate than that of the current 
standard is needed to accomplish this. 

Low signal level digital errors produce distortions such as 
quantization noise and resolution loss. Whereas, high signal 
level high frequency and slew rate related errors produce 
distortions such as sporadic beats and fast signal change 
envelope related subharmonics, referred to as transient intcr- 
modulation distortion or TIM. One is easily misled by test 
signals with a continuous envelope nature, in that they tend 
to average over time and cancel many of these distortions 
and therefore incorrectly indicate only very small resolution 
and converter inaccuracy distortions. Unfortunately, wave- 
forms Uke those in music continually change and, as noted, 
may provide much higher and far more objectionable non- 
harmonic TIM and resolution problems. 

Digital distortions occur with high slew rate and small 
amplitude signal change conditions and, as previously 
indicated, both are not likely to occur at the same time. 
Hence, in accordance with the invention, the system iden- 
tifies either a fast slew or a small change character of the 
signal waveform and implements the appropriate corrective 
process. During encoding, the nature of program signal 
changes can then determine which corrective process is used 
as well as a best reproduce conjugate or process at any time 
during decoding. One process can borrow information rate 
from a less needed performance capability when potentially 
severe distortion conditions in the signal call for it. In this 
manner, a decision to provide more points per fast voltage 
change yields an equivalent higher sampling rate at the 
expense of less important low level resolution. Conversely, 
a smaller voltage change per sample automatically reduces 
the momentarily unneeded speed capability. Such interplay 
and compromise can be managed and/or computed to main- 
tain a substantially constant digital information rate. Under 
these circumstances, the processed, decoded, analog output 
may have an apparent increase of bandwidth and resolution 
and, as noted earlier, when these improvements occur, one or 
the other as needed, the fundamental causes of digital 
distortions as well as their effect on imperfect reproducers 
can be reduced. 

A similar correction strategy is applied to reduce filter 
trade-off compromise errors between transient response, 
phase accuracy, settling time, group delay, and other distor- 
tions inherent with filtering methods. Such errors may not be 
non-linear, and hence, will not appear as harmonic distor- 
tion; however human hearing is sensitive to manipulations 
of waveform shape and to the settling time of complex 
signals. Typically, the smallest amplitude high frequency 
signals are likely to have excessive transient ringing and 
process noises from aggressive filtering, whereas sub- 
harmonic beats and other filtering noises may occur with 
intense high frequency signals. The instantaneous versus 
non-instantaneous character of complex signals is repro- 
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duced differently from one filter type to another. As before, 
the same large signal/small signal selection criteria hold, 
allowing a best encode and decode filter choice, without 
having to compromise for the opposite, essentially non- 

S coexistent, program conditions. 

Hence, the method and apparatus of the present invention 
utilize a pre-calculated optimal interplay of gain, slew, filter 
selection, and waveform synthesis operations done individu- 
ally or as a composite all inclusive process which becomes 

10 encoded and decoded in a complementary manner to reduce 
distortions and improve resolution. Included in such a sys- 
tem is a record compress — play expand system with some 
features similar in ways to those used in noise reduction 
systems. Most such noise reduction systems use either peak 

15 or RMS detectors to examine the incoming signal and 
convert its level to either fast or slowly changing internal DC 
control signals which ultimately drive a transient free 
switching element or an analog variable gain device. When 
set up for gain reduction, with increased input signal level, 

20 the output signal is compressed so that tiny signals are 
amplified and strong distortion prone signals are attenuated. 
Upon playback or decoding, a similar circuit set up for gain 
expansion, detects level changes and restores the signal to an 
approximation of its original dynamics. 

25 In contrast to traditional noise reduction, the system of the 
present invention corrects distortion. It does this by altering 
gain structure, as well as amplitude and slew rate linearity, 
for extreme low and high level signal conditions. Low level, 
small changing parts of the signal are detected and iised to 

30 control the gain of the whole signal which then includes 
more encoded bits. This gain control is derived from a broad 
middle spectrum of the signal and is active at signal levels 
representing the lowest levels perceived by human hearing. 
It is not activated by low frequencies, near supersonic 

35 frequencies, or when higher level mid-band signals are 
present. In this manner, the gain structure increase maintains 
a minimum LSB dither-like activity independent of inau- 
dible sounds and maintains ambient and backgroimd infor- 
mation as well as masking quantization and monotonistic 

40 error distortions previously described. 

Infrequent peak levels are instantly compressed with a 
transfer function having very low distortion for signals near 
maximum level and producing minimum upper harmonics 
once the limit threshold is traversed. This type of operation 

45 does create an occasional higher distortion on peaks, how- 
ever it prevents catastrophic overloading during recording 
and allows a higher recording level with overall lower 
distortion. 

Infrequent fast slew portions of the waveform can be 

50 expanded symmetrically in time, and/or in samples, to 
encompass more encoded bits, and, as before, other parts of 
the waveform may be unaltered. This operation may be a 
dispersion process where time delay is altered, or it can be 
a graphical waveform synthesis. It takes an instantaneous 

55 event and spreads it in time, and like the peak limiter, it 
creates distortion in undecoded playback 

Gain change, peak limit, and slew rate compression 
operations and their complements or restorative operations 
are practical with analog or digital techniques. Voltage 

60 controlled amplifiers, diodes, delay lines, and chirp filters, 
and multipliers are typical analog building blocks which can 
be assembled to create these functions. Equivalent digital 
sub-routines and dedicated process algorithms and compo- 
nents are also available. Distortion free digital processing is 

65 complex; for example, rounding off errors may have to be 
dithered and interpolated over time. However, once 
implemented, digital operations are very stable and precise 
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compared to the variables subject to tolerances and adjust- 
ments required for the analog control of gain, dispersion, 
bandwidth and time constants. 

The aforedescribed level and slew processes of the 
present invention correct distortions occurring from oppo- 
site signal conditions which are not likely to occur at the 
same time. Hence, these can interplay and at maximum 
correction capacity can borrow from an opposite less needed 
performance capability to maintain constant digital infor- 
mation rates. The wave synthesis process of the present 
invention operates with known distortion waveshapes 
which, when encountered during encoding, are subsequently 
called out of memory by code for complementary correction 
during reproduction. 

Level and slew correction works for known signal con- 
ditions having unpredictable distortions and synthesis works 
for known distortions occurring from signal conditions 
unpredictable at the reproducer. Unlike even stale-of-lhe-arl 
noise reduction processes, this system's processing is under 
intelligent control and given sufScieat computation, trial and 
error, or successive approximation time, the best correction 
scheme and its encoding for reproducer process control is 
readily determined and optimized. 

Wave synthesis, in accordance with the invention, is a 
keyed operation used to recall from memory a number of 
predictable and/or recurrent distortions known to occur at 
the reproducer. Small waveform segments falling outside of 
the Nyquist sampling limits, repeated quantization 
distortions, and interpolation filter parameters can be 
recalled from a look-up table in memory or synthesized from 
information sent in the hidden code, and used for improved 
playback. The synthesis memory can carry several interpo- 
lation waveshapes which best connect points at and between 
samples. These larger waveforms will maintain their char- 
acteristic shape independent of level, just as the reproduced 
signal would do. Once the connecting waveshape has been 
recalled from ROM, it must be scaled to fit the signal. Since 
only very slowly changing waveforms will have samples 
without bit resolution levels in between, a form of level 
detection is necessary to make synthesized segments scaled 
to the signal. What would have been level detectors and gain 
controlled devices in an analog system are replaced by 
equivalent digital signal processing functions in a digital 
system. Once this has been accomplished, the reconstructed 
waveform has more equivalent data points in time and level 
and, when pre-computed properly, a lower distortion results 
from the curve fitting. 

In Ught of the foregoing, a practical system, in accordance 
with the invention, may have many times better signal 
resolution and much better fast transient signal accuracy. A 
much greater digital information rate would normally be 
necessary to adiieve these results. Data is saved by process- 
ing only distortion producing conditions. As noted, resolu- 
tion is selectively and adaptively traded off for slew accu- 
racy and slew rate or maximum level is borrowed for higher 
resolution. Information rate is conserved by toggling back 
and forth or fading from process to process when needed. 

It should also be apparent that implementation of various 
subsystem designs may be in either analog or digital form, 
monitoring and analysis of the waveform may be accom- 
plished at varying locations in the system including the 
reproducer and in either analog or digital form, other param- 
eters of the waveforms may be selected for compensation, 
and control codes or other waveform corrective message 
information may be inserted and extracted in a variety of 
different ways, without departing from the basic concepts of 
the present invention. 
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Hence, the method and apparatus of the present invention 
for encoding/decoding signals with minimal distortion sat- 
isfies a long lasting need for a compatible system which 
provides an adaptive interplay of gain, slew rate, filter action 

5 and wave synthesis processes to substantially reduce signal 
distortions and improve apparent resolution. 

The above and other objects and advantages of the 
invention wiU become apparent from the following more 
detailed description, when taken in conjunction with the 

10 accompanying drawings of illustrative embodiments. 

DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an overall block diagram of an analog to digital 
encoding system in accordance with the invention; 

FIG. 2 is an overall block diagram of a digital to analog 
decoding and reproducing system in accordance with the 
invention; 

FIG. 3 is an more detailed block diagram of an example 
20 of an analog to digital encoding system in accordance with 
the invention; 

FIG. 4 is an more detailed block diagram of an example 
of a digital to analog decoding and reproducing system in 
accordance with the invention; 
25 FIGS. 5a through 5e graphically depict waveforms illus- 
trating samphng and encoding errors encountered with low 
level and rapidly changing waveforms; 

FIGS. 6a through 6/ graphically depict various signal 
waveforms during the limiting and reconstruction of a 
triangle wave, in one embodiment of the invention; 

FIGS, la through 7d graphically depict waveforms illus- 
trating various types of distortion encountered with different 
types of filters; 

35 FIG. 8 is a block diagram of a processing system in 
accordance with the invention, using analog processing 
technology; 

FIG. 9 is a block diagram illustrating filter selection 
control in one embodiment of the invention; 
40 FIG. 10 is a block diagram of a process switcher utilized 
in one embodiment of the invention; 

FIGS. 11 and 12 graphically depict waveforms and dis- 
tortion plots illustrating system response before and after 
process for two filter types, in accordance with the inven- 
tion; 

FIG. 13 is a block diagram of an analog implementation 
of a slew rate compression and expansion system; 

nGS. 14a through 14e show waveforms illustrating the 
operation of a slew rate compression and expansion system; 

FIG. 15 is a block diagram of a more advanced, presently 
preferred digital embodiment of the encode system, in 
accordance with the invention; and 

FIG. 16 is a block diagram of a more advanced, presently 
55 preferred digital embodiment of the decode system, in 
accordance with the invention. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

60 The present invention is directed to a system for an 
electronic method and apparatus for signal encoding and 
decoding to provide ultra low distortion reproduction of 
analog signals, while remaining compatible with industry 
standardized signal playback apparatus not necessarily 

65 incorporating the decoding features of the invention. The 
improved system provides a selective interplay of gain, filter 
selection, slew rate and wave synthesis operations to reduce 
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signal distortions and improve apparent resolution from a or disc, is directed as input to a digital signal analysis and 

recorded product, under the control of concealed or silent processing subsystem 104 and to menaory subsystem 107, 

control codes when necessary for triggering appropriate which delays the digital signal. Signal analysis subsystem 

decoding signal reconstruction compensation based upon a 104 extracts control code information inserted in the signal 
previous signal waveform analysis made during the encod- 5 at the encoder and may also analyze the signal itself to 

ing process for the recorded product. In addition, signals determine its characteristics. These operations include 

lacking the encoding process features of the invention are appropriate means for control code detection, signal 

likewise compatible with playback decoders which do filtering, level detection, spectral analysis and the like. The 

embody the invention, and are provided the benefits of some detected control codes and signal analysis in the processing 
overall enhancement based upon a signal waveform analysis lO subsystem 104 are used to generate control signals directed 

made during playback. to a reconstruction compensation subsystem 105 which 

Referring now to the drawings, and more particularly to interacts with the processing subsystem 104 and operates on 

FIG. 1 thereof, there is shown, in general terms, the analog the delayed digital input signal 108. Subsystem 105 includes 

to digital conversion and encoding subsystem of a typical digital to analog conversion, and may include further 

recording system embodying features of the present inven- memory, such as one or more ROM's or look-up tables, for 

tion. various types of reconstruction compensation used, in accor- 

As shown in FIG. 1, an analog signal 99 is directed as ^^""^ invention, to correct the digital signal 103. 
input to a processing subsystem 100 which converts the The compensation subsystem 105 typically will respond 
analog signal into digital form, including such tasks as various control codes, or the absence thereof, to 
filtering, sample and hold, analog to digital conversion and generate a variety of corrective compensations such as slew 
the like. The digital output lOOa from the subsystem 100 is rate, level, filter selection, and waveform synthesis which, 
directed to two subsystems, a memory subsystem 101 and an through appropriate interaction with the processing sub- 
analysis and computation subsystem 102. In memory sub- system 104, yields a reconstructed analog signal 106 with 
system 101, the digital signal is delayed or stored for further minimal distortion and enhanced apparent resolution, all 
use and manipulation. The digital signal output of memory ^ without the need for increasing industry standardized digital 
subsystem 101 is sent to subsystem 102 at input 102E. Using bandwidth. 

the output of subsystem 100 at input 102A, the waveform It will be appreciated by those of ordinary skill in the art 

analysis and correction computation subsystem 102 continu- that the systems of FIGS. 1 and 2 are merely illustrative of 

ously monitors and evaluates the digital format waveform as simplified general approaches for practicing certain basic 

it is being stored in the memory subsystem 101 in order to aspects of the present invention, and implementation of the 

determine the physical characteristics of the stored wave- systems of FIGS. 1 and 2 may take a wide variety of specific 

form ultimately to be reconstructed and the required correc- forms without in any way departing from the spirit and scope 

tions necessary for accurate reconstruction and restoration of of the invention. 

the original analog waveform 99. This evaluation relates to ^ should also be apparent that implementation of various 

reconstructive level, slew, and waveform synthesis require- subsystem designs may be in cither analog or digital form, 

ments ultimately to be provided by complementary com- monitoring and analysis of the waveform may be accom- 

pensatioa in an appropriate decoding and signal reproduc- plished at varying locations in the system and in either 

tion system (FIG. 2). The evaluation may also predict alias analog or digital form, other parameters of the waveforms 

components for subsequent conjugate neutralization. Some may be selected for compensation, and control codes or 

aspects of the signal evaluation may be performed on the other waveform corrective message information may be 

analog signal by subsystem 100, and the results sent to inserted and extracted in a variety of different ways, without 

subsystem 102 at input 102d. departing from the basic concepts of the present invention. 

-Hie corrective procedures are appUed to the digital signal By way of example, one possible implementation of the 

from the memory subsystem 101 by subsystem 102 under general structure above is presented in more detail in FIGS, 

the control of signals resulting from the analysis. The 3 and 4. These drawings correspond to FIGS. 1 and 2, and 

process controller 102 also generates control codes for use illustrate more internal detail. 

by the decoder which are converted to proper format and ^^^^ ^^^^ specifically to FIG. 3 of the 

appropnately encrypted into the digita signal so that the ^^^^ ^^^^^ ^ ^^^^ ^.^^^^ ^^^^j. 

control codes can silently nde alone with the digital repre- * * j *l - a 1 . 

, ■ . 1 , ^ r an J ._ ^ 50 system m accordance with the mvention. Analog input 

sentation of the oaginal analog waveform 99 and be pro- • 1 on • 1* j * u re *u ^ * 1 : r 

, J- •* 1 * * ini n r .i^ Signal 99 IS applied to a buffer amphfier, thc first element of 

vided as an eDcoded diptal output 103 Some of these ^^^j ^^^system 100. The output of the buffer 

correcave procedures wiU re ate not just to distortion char- ,„,piifler drives an analog low pass anti-aUas filter, which 

acteristics occurnng as a result of the basic conversion of the „„„„^. i,:„k «f tu^ 

1 c ^ ic i_ . 1 J J ,.L , removes any mgn irequency components or the input signal 

analog waveform itself but also to procedures dehberalely „ ^^^j^ ^ Nyquist limit of half the sampling fre- 

introduced by the encoder for subsequent complementary q^ency. The output of the lowpass filter has an analog dither 

decoding, such as peak lim.t/subsequently expand for high ^. ^^ ^^^^ Jj, ^ 

level signals and averaged compress/subsequently expand ^ jj ^^ ^^^^ ^^^^^^^ ^^^^^ ^^^^ 

tor low level sio^nals = » o > 

^ * signal amplitude is sampled at regular intervals and the 
As best observed in FIG. 2, there is shown, again in amplitude of each sample is converted into a number or 
general terms to illustrate some of the basic overall concepts digital word. The series of digital words from the converter 
embodied in the present invention, a digital to analog make up the digital signal, which is sent to the analog to 
conversion and decoding subsystem of a typical reproducing digital conversion process controller. This process controller 
system embodying various features of the present invention has generated the dither signal which was added to the 
for reconstructing the original analog waveform. ^5 analog signal before conversion, and, typically, the control- 
In FIG. 2, the encoded digital signal 103, recaptured from ler subtracts the dither from the digital signal, giving a 
any appropriate recording medium (not shown) sudi as tape vernier enhancement to the conversion accuracy as well as 
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Spreading any converter nonlinearities into a noise-like The final task of the code encryption unit is to encode the 

signal. The ADC process controller may also make other composite digital signal into an ind\istry standard format for 

corrections or additions to the conversion process, such as recording, etc. The output of this unit is a standard digital 

noise shaping. The output of this module is a high resolution signal 103, which, for instance, could be sent to a recorder, 
digital signal 100a which is sent to subsystems 101 and 102. S Tbis completes the description of the encoding system. 

It should be noted that this digital signal has both higher Referring now to FIG. 4 of the drawings, there is shown 

amplitude resolution and greater sampling rate or time an example of a digital to analog decode/reproduce system 

domain resolution than the industry standard digital signal ^ accordance with the invention. The input digital signal 

which is the final output of the encoding system. 1^3, from a tape recorder, CD, etc., is applied to the signal 

Memory subsystem 101 is used to delay the high resolu- lo ^ ^^y^^ ^^^system 104 and to memory subsystem 

Uon digital signal 100a before sending it to 102e. Tliis time ^ ^^^^^^ ^ 

delay gives subsystem 102 tmie to analyze the signal and ^^^^ ^^/^ ^^^^^ ^^^^ subsystem 104 time to 

choose appropriate correcUve procedures to be apphed dur- ^^-^ analysis Tlie delayed digital signal output 108 of the 

mg encodmg. memory subsystem is sent to the level control unit of 

The high resolution digital signal from subsystem 100 is subsystem 105. 
also sent to the signal analysis process controller unit of The digital input signal 103 is also applied to the signal 
subsystem 102 at input 102fl. This unit analyzes the char- analysis, code analysis and process control subsystem 104. 
acteristics of the signal as it is being stored in the delay This subsystem separates from the signal the silent control 
memory 101 and makes decisions about employing correc- code inserted by the encoder. This control code contains 
live procedures such as instantaneous peak amplitude information about what processing choices were made by 
limiting, low level gain compression, choice of best "brick the encoder and what complimentary corrections should be 
wall'' low pass filter, transient reconstruction and so forth. applied to reconstruct the most accurate reproduction of the 
The unit then sends commands 1026 to the units which original analog input signal. The subsystem may also ana- 
process the delayed digital signal to carry out the corrective lyzc the signal itself to determine the best reconstruction 
procedures. The signal analysis process controller also gen- ^ strategy, measuring such parameters as the signal amplitude, 
erates a control code 102c which it sends to the code spectral content, etc. The subsystem then generates a series 
encryption unit for addition to the output signal. This control of control signals to control the various units within the 
code tells the decode system what has been done and how to reconstruction processor 105, each of which performs a 
recover an accurate representation of the original input specific type of operation on the program signal. 
s^S^^- The reconstruction compensation and digital to analog 

The delayed high resolution digital signal from the conversion subsystem 105 is made up of a number of 

memory subsystem 101 is sent to the decimation filter unit processing units which operate on the program signal under 

at 102e. Here, the oversampled input signal is decimated the control of the analysis and process control subsystem 
down to the industry standard sampling rate. The choice of ^5 104. Each of these units has a control connection to 104. The 

optimal filter characteristics is dependent on the nature of first of these is the level control unit, which receives the 

the program signal at the time. Such factors as transient delayed digital input signal 108. The level control unit 

content of the signal, presence of large amounts of alias performs amplitude scaling complementary to that per- 

producing high frequencies, etc. are taken into account by formed by the encoder, such as instantaneous peak expan- 

the signal analysis process controller, and a filter control sion and signal averaging based low level expansion. The 

signal 1026 tells the decimation filter which parameters to output of this unit is a digital signal at the input sampling 

use. The output of the decimation filter has the indusu-y rate, but with higher amplitude resolution than the input, 

standard sampling rate and very high amplitude resolution. This output is sent to the interpolation filter unit. 

It is sent to the level control processing unit. The interpolation filter unit creates an oversampled digital 

The level control processing unit uses such operations as 45 signal by interpolating between the points represented by the 

instantaneous peak level compression and low level average input signal. The best filter parameters for this interpolation 

gain compression to squeeze the high amplitude resolution are chosen dynamically based on the control codes, and 

of the signal into the industry standard resolution (such as 16 possibly also signal analysis, so that they complement the 

bits for CD). These operations are done under the control of parameters of the decimation filter in the encoder. Other 
the signal analysis process controller. The level control unit 50 processing such as noise shaping and transient reconstruc- 

may also include other techniques such as the addition of tion may also be done by this unit. The output signal of this 

digital dither to allow resolution below the least significant unit is a high resolution oversampled digital signal which is 

bit level and transient time domain or slew rate compression. sent to the digital to analog converter unit. 

The output of this unit is sent to the silent code encryption The digital to analog converter (DAC) unit converts the 
unit. 55 high resolution digital signal into an analog signal. It may be 

The silent code encryption unit takes tiie control codes a standard converter or a multiplying converter which is 

102c from the signal analysis process controller, which are to further effect level changes in the signal. The output 

commands and information for the decoder system, and adds of ^ ^ an analog signal which is sent to the analog 

them to the digital signal. One method of doing this involves processing unit. 

encrypting them into a pseudo-random noise-like signal and 60 The analog processing unit contains an analog interpola- 

inserting it as needed into the least significant bit of the tion filter and buffer amplifier. It may also contain other 

digital signal. Other methods include the use of "user** bits processing, such as level control, under the control of the 

in standard code or unused bit combinations which may analysis and process control unit. Since it is operating on an 

appear to be errors to a normal decoder. The common analog signal, the control signal may be converted to analog 
characteristic of these methods is that they provide a silent 65 form in the control DAC before being applied here, 

side channel for control information which rides along with The output of the analog processing unit is an extended 

the program digital signal. range analog signal 106, which is a close replica of the 
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origiaal analog input signal 99. The overall system of the Basically, one aspect of the system of the present inven- 

invention makes possible a more accurate reconstruction of tion addresses and partially corrects several distortions 

the original analog signal than would have been possible known to occur with A to D and D to A conversions of 

from conventional systems using the same digital recording complex signals. Some of these errors are hardware related 

standards. 5 and are correctable with more exacting methodology. Other 

The ensuing analyses and discussion are intended to distortions are the result of the bit depth and sampling rate 

provide further background for a proper understanding of fixed by industry standards and are minimized creatively by 

the practice of the invention and to further illustrate and the system, by varying dynamic optimization between per- 

describe a variety of analog/digital modes presently con- formance aspects. Determining the best form of optimiza- 

templated as feasible for carrying out the invention. tion can be very complex, as many such distortions do not 

Analog to digital encoding, in accordance with one aspect occur with the steady state type signals used for distortion 

of the present invention, works as a sample rate down tests, and must be minimized to subjective criteria. Most are 

converter which allows resolution enhancement and reduced transient intermodulation distortions (TIM) of which certain 

filter artifacts. Analog to digital conversion is made at a high types are objectionable 50 to 60 dB below the program 

sample rate and extended bit resolution, both well above that material. As will be shown, the hardware mechanisms for 

required for the final product encoded format. This high producing these distortions are non-linear switching and 

density code is then arithmetically processed back to the hysteresis in capacitors in sample and hold circuits, digital 

desired end use number of bits and sample rate. With this iq analog crosstalk, slew rate asymmetry from large numbers 

auangement, many advantages occur. Analog "brick wall" p^^s in the signal path and crosstalk between analog and 

low pass filtering is unnecessary as the very high ingoing digital signals 

sample rate allows much more gentle and phase — time ^'^ r™ j- ^ *t. • *• i 

J ^ . .11 J j-t_ J *cci_r KT -*j-* The encodme process of the invention makes program 

domain controlled audio band cut on before Nyquist distor- . , ^- ^i. i * ji.i c 

tions occur. The sample and hold-analog to digital con- ^^^^^^ alterations with the least audible consequence for 

verier subassembly can be supersonically dithered in a reproduction from standard equipment These changes 

known and controlled way to create duty cycle modulated reduce ccrtam types of distorUons and mcrcasc signal 

low level code parts in which any monotonicity or missing 25 resolution, thus providmg improved playback, e.g., better 

code errors are spread out as noise sidebands around the spatial sense and less brittleness. Using the decoding process 

dither signal. These will be very high frequency and, hence, of the invention, the reproducer can be made to track and 

almost inaudible, unlike signal related noises of standard inversely compensate these signal alterations thereby allow- 

systems. iiig substantially "exact" playback, with greatly reduced 

An important advantage is that the "brick wall" low-pass 30 distortion, 

filter required to prevent Nyquist — ^Alias errors can be In order to provide a further understanding of the prob- 

implemented as a digital filter, which has highly reproduc- lems with digital systems and how they are resolved by 

ible characteristics free from phase distortions. The charac- practice of the invention, the difficult technology areas and 

teristics of this filter can be chosen dynamically based upon distortion mechanisms occurring from ideal as well as 

an analysis of the high resolution signal to minimize distor- 35 practical implementations arc presented as follows: 

tion. Hence major filter and analog to digital encode system 1. Resolution limitations with anall signals 

problems such as pre-echo, transient ringing, group delay Distortions in digital systems increase with decreasing 

anomalies, missing code errors, alias distortion and beats are signal levels, and the smallest signals become broken and 

greatly reduced or eliminated, tend to disappear. A good analog system and a 16 bit digital 

A very powerful arithmetic "engine" and operating 40 system can both handle signals with an 85 dB dynamic 
program, as well as digitally operated feedback and feed- range. Typical analog systems have infrequent high distor- 
forward parts are utilized to make the wideband audio to tion at signal peaks whereas digital systems have continuous 
selected format digital conversion. However, such a system distortions at low levels. Experience has shown these dis- 
also easily performs instantaneous high level limiting and tortious to be audible, hence some form of noise dithering is 
averaged low level expand operations. In practice, approxi- 45 often used to smooth out quantization steps and allow 
mately an extra 4 bits dynamic range can be had from information fill-in. This technique creates new distortion 
systems having complementary playback and significanUy from t)eats between dither, sampHng and signal frequency 
improved sonics will occur from standard unprocessed com- differences. Nearly inaudible low level upper harmonics 
patible playback systems. This is because the recording then create more perceptible low level sub-harmonic inter- 
engineer can raise levels without overload problems, thereby 50 ferences. 
simplifying recording sessions and very low level ambient P^*^- 5fl,fcjif 

information will always maintain least bit activity to prevent Sampled, encoded, and decoded low level low frequency 

monotonistic errors. Both processes on a "perfect" system signal, 

would be inaudible. However, on real digital systems the FIG. Se 

sonics will improve, as the slightly higher levels reproduce 55 Above dithered with high pass filtered random noise, 
with lower distortions through digital systems. Both the A unique solution to the aforedescribed problem is pro- 
instantaneous peak limit/expand and the averaged compand/ vided by the system of the present invention, 
dccompand functions are controlled so that the degree of In this regard, a minimum low level signal activity is 
processing can be computed and automatically controlled as maintained at all limes by using a gain expanding device or 
needed for best program reproduction. This configuration 60 its equivalent digital process to increase the gain of the 
allows very fast corrective action to be varied by a low system only when the average level of the signal is low. This 
bandwidth control signal. This control signal can be hidden low level gain riding is programmed to maintain a minimum 
within error correction codes, placed on other audio chan- LSB dither-like activity which will tend to mask quantiza- 
nels within the system, or random noise encrypted and tion effects or other least significant bit monotonistic dis- 
inserted as needed into the least significant bit or bits. In this 65 continuities. The reproduced program will soimd better on 
regard, the benefits far exceed any added error which is less expensive players not incorporating the invention, 
below the practical resolution limits of most equipment. which often have high distortions from these kinds of 
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problems. For exact decoding, the invention provides an then be made to track the compression exactly, and the shape 

opposite gain-structured average level compression device of the limiter curve can be controlled for least distortion on 

or equivalent digital process which restores the full dynam- undecoded playback. In order to make the scheme work 

ics of the original signal. When this complementary process effectively in the digital domain, however, one must have an 

is used at the reproducer, low level gain reduction occurs and 5 analog-to-digilal and digital-to-analog converters with suf- 

quantization noise is reduced. ficicnt amplitude resolution to handle the dynamic range. 

Best operation of the process occurs when gain control is If the peak limiting operation is applied to analog signals 
based upon a broad middle audio spectrum, as this restric- at the encoder input it can be digitally conjugated to yield a 
tion prevents gain pumping from noise and bass fimdamen- linear signal of more data bits. This effectively creates an 
tals. An average level detector controls a variable gain 10 A-to-D converter with higher resolution which has higher 
function as follows: An RMS detector or other averaging enors for signal peaks where the diode compression occurs 
type device receives these signals. Gain boost is determined than for the majority of its dynamic range, 
from the band restricted program and its average boost level Building block or functional module circuits can be 
is controlled by attack, sustain and decay parameters much hooked up to perform the input and output analog opera- 
like those in synthesizers. To prevent overload from sudden 15 tions. Voltage controlled amplifiers, four quadrant 
signal changes, the unmodified full bandwidth program is multipliers, log-exponential converters, and multiplying 
delayed long enough to allow time constants needed for the DAC systems are available. Most of these devices make a 
averaging process to respond and anticipate events. The more logical and direct implementation, but they also have 
delayed program is then gain controlled either by adding the temperature tracking problems and most of them create 
signal to itself or by multiplying. These methods provide the 20 higher noise and distortions than the method we use. 
benefit of undecoded reproduction with the lease audible In the digital domain, DSP programs can work, on a 
artifacts. one-to-one mapping basis for signal reconstruction by a 

A decoding reproducer can operate in the aforedescribed decoder, firom lookup tables, arithmetic sub-routines, and 
manner except that it performs a gain reduction in response process combinations. Just like low level averaging this 
to its own determination of average signal level, using a 25 operation can test decoder response, determine a fix, and 
control signal detected from a reduced bandwidth version of then make the correction to a delayed data signal. Certain 
the input signal, having attack, sustain, and decay time types of transient ringing occurring after decimation will 
constant averaging to operate a gain control process passing create some re-construct distortion to very large signals, 
the delayed program. This default or non-controlled mode Ttese errors are similar to those in other dynamic range 
can be made sufficiently accurate since the recorder has the 30 enhancement systems. They appear to be an accepted corn- 
same building blocks and can test the reproducer response promise of dynamic range enhancement and for now we 
for a program event and make touch up corrections prior to have not dealt with the problem, 
the full band signal reaching the variable gain device. 3. Limitations of low pass anti-alias filters 

This system operates like many compress/expand type The industry standard low sampling rates force a very 

systems. Various internal operations like filtering, detection, 35 narrow transition region between pass and reject responses 

gain control, integration for time constants, time delays, log of anti-alias filters. This very greatly increases complexity of 

conversions, and curve generation can be made operable either analog or digital filter implementations and prevents 

from functional modules or from known digital process having all aspects of filter performance optimal in one 

programs. An analog system can be constructed from such design. A compromise results. Best resolution for extended 

building block functional units. Each unit is fully buffered, 40 high frequency response and Nyquist rejection necessitate 

gain structured, and instrumented allowing many different poor transient and time settling response. Less aggressive 

types of systems to be set up easily. A more detailed filtering gives less high frequency extension with improved 

description is found below as part of the circuit description. transient settling or gives improved high frequencies and 

2. Catastrophic overload fi'om large signals poor alias rejection. Filter sonics are different from one to 

Large signals can suddenly overload a digital system to 45 another and each works best with certain types of program 

create severe unmusical crackling and other breakup sounds. material. The filters shown below are symmetrical, fixed 

Most analog recorders gradually overload with program group delay types made from large numbers of sections 

related harmonics, are more forgiving, and therefore work representative of good finite impulse design practice, 

closer to their maximum capability. Recording engineers FIG. 7b 

using digital equipment typically will choose more conser- 50 Low Alias filter: extended maximally flat high fi-equency 

vative levels and risk the resulting lower resolution and response, maximum alias rejection, steep transition 

higher distortion, region. 

^!^~f, , , , . , Electrical: Rapid changing high frequencies have unsym- 

Digital/Analog overload on triangle wave. n^etrical sidebands which create vestigial amplitude 

Aumque solution to this problem is also provided by the 55 • . ^^^^^ . ^^^^ ^-^^ transients. 

system of the present invention. ^ t j- *i i- 

, J 1 1- • J . • •. . 1 Sonics: Inner detail sound IS compromised to get low alias 

In this regard, a peak hmiter is used to imitate analog distortion at hieh si nal levels 

overload. Higher peak distortions occur infrequently, but 11 ig" 

now the average program level can be higher, and the ' ^ 

average percent distortion is usually lower. Exact program 60 Compromise filter: Reduced high frequency response, 

reproduction is restored by a peak expansion having a l^^S^r transition region, reasonable Nyquist rejection, 

conjugate transfer function to that used to limit the program. Electrical: slower transient response with faster settling. 

This peak limiting can be applied to the signal either in the less flat frequency response. 

analog domain, before it is converted to digital, or in the Sonics: Dull soft dynamics, moderate inner detail, mod- 
digital domain, and the conjugate expansion can likewise be 65 erately clean high frequencies — best for simple low 
applied in either domain. The preferred method is to do both level signals, 
operations in the digital domain, since the expansion can FIG. Id 
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High resolution filter; good transients, but peaked high 
frequencies and poor alias rejectioa. 

Electrical: High frequency response has a dip and then a 
peak, producing steep transients and fast transient 
settling time. Complementary decoding yields very fast 
transition speed to infrequent transient edges. 

Sonics: Best for complex signals when alias distortion 
does not create problems. Poor cymbal sound. 

Near ideal digital or analog implementation of the above 
filters is theoretically possible. Both are characterized by 
similar equations. No one of the above works best for all 
situations; each has its compromises. 
The aforedescribed problem is likewise resolved by the 
system of the present invention. 

Observe the program data and dynamically choose a best 
encoding filter automatically, based on the program content. 
Send to the reproducer coded control signals indicating these 
filter choices. This makes it possible for the reproducer to 
initiate its own complementary or conjugate response to the 
encoding filter characteristics. 

Filter corrections require an operational system consisting 
of encode filters, decode filters, selection logic, a means of 
switching from one filter to another, time delays, and a 
means of encoding control signals for the reproducer. Each 
of these can be performed in the analog or digital domain 
and quite often easy processes in one are quite difficult in the 
other. A brief description of each subsystem follows: 
Digital Filters 

Complex filters are best created by specialized DSP chips. 
A typical DSP chip is configured with 24 bit multipliers and 
56 bit accumulators in a functional configuration which is 
very efficient at performing the multiply and add operations 
required for digital filter algorithms. DSP chips can be used 
to make symmetrical finite impulse response filters, convo- 
lution networks, spectrum analyzers etc. In most instances, 
a filter equation is designed using a computer to simulate its 
response and the resulting coefficients are then incorporated 
into a program for insertion into the DSP chip's memory. 
PROM chips are programmed with these numbers and 
connected to the DSP, or for volume production an equiva- 
lent mask programmed ROM may be used, which may even 
be resident in the DSP chip. Hence, different filter responses 
can be achieved by changing to different program coeffi- 
cients or different programs, all stored in ROM, or by using 
several separate DSP processors, each running a single filter 
program. 

This approach applies to decimation, which reduces over- 
sampled data to an "alias free" lower sampling rate and is 
used during encoding, or to interpolation, which produces an 
oversampled signal and may be used during the decoding 
process. Both involve the use of low pass filters and both 
rely on multiple or oversamples of a base or industry 
standard sample rate. 

Decimation takes a stepped "curve" of multiple samples 
for each one needed and finds the best number for each 
sample at the desired rate and discards the rest. Since 
waveform reversals within each final sample period do not 
reproduce and only create distortion because of the Nyquist 
limit, a low pass filter operation must remove the alias 
frequencies of such events, eliminating the audio conse- 
quences. In one system, we use a 16 bit converter operating 
at an 8 times oversample rate, and in another, an 18 bit 
converter operating at 4 times oversample rate. In theory we 
gain 2-3 bits from subtractive dither with oversampling and 
gain another two from limiting. During any one sample, 
hundreds of DSP operations on these bits will have been in 
process and accumulated to produce an encoded low pass 
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filtered number 24 bits long. For our system, 20-22 of these 
bits can have useful information. 

Interpolation takes each sample and creates a stepped 
"curve" of many computed intermediate values or over- 
5 samples. Here the intent is to reconstruct a waveform like 
the original signal. As before, hundreds of DSP operations 
are needed and again fully processed points between 
samples as well as any computed signal restorations become 
added bits to the DAC. With the system of the present 
invention, we then get 24 bits at an 8 times oversample rate. 
Of these 24 bits, approximately 20 bits contain useful 
information, and digital to analog converters with this reso- 
lution are just becoming commercially available. 

Because of DAC performance limitations, it may be 
necessary to handle the added bits from limit restoration and 
low level averaging during or after digital to analog con- 
version. In one version of the system, an 18 bit 8 x sampling 
DAC and noise shaping is used to achieve a theoretical 2-3 
bit resolution improvement to the stepped curve interpola- 
tion. 

20 Filter Selection Logic 

Best filter choices are made when program conditions 
reveal a compromise problem. Strong high frequencies, 
isolated fast transients, and continuous low levels encode 
best with specialized filters. Fortunately, each condition is 

25 easy to identify and each is most likely to occur by itself. 
Conditions such as loud or soft, continuous or broken, and 
strong treble are representative of those which are identifi- 
able and cause problems. Program materials are not predict- 
able and solo voice/instruments, synthesizer, percussion, 

30 and so forth may present rapidly changing requirements. 
Unfortunately, filter lengths, enhanced transients, filter 
merges, and identifying program conditions all operate with 
time constraints. Therefore, filter changes may have to be 
restricted when program conditions call for choices which 

35 alternate too rapidly. 

A best compromise over time is made by memory 
enhanced variable threshold smart logic. Normally a filter 
"call" is initiated in response to a compromise situation. The 
call represents the intensity of the demand for a particular 

40 filter, caused by the compromise situation, integrated over a 
weighted time window. If the program doesn't change much 
and the call is not continuous and doesn't happen again, the 
previous best filter remains. Each successive call, its length 
of time and intensity increases the response sensitivity to 

45 engage that filter. If this choice is made, then the response 
sensitivity to engage any other filter is reduced over a preset 
time and the process like above now can repeat for a new 
filter. This selection method eliminates haphazard filter 
toggling and still allows quick filter changes when a strong 

50 filter compromise situation occurs. 

Although this operation is suited for digital 
implementation, a hybrid analog and digital circuit is less 
complex and has allowed easy experimentation with pro- 
grams. Diodes, resistors, capacitors, comparators, and cur- 

55 rent sources make up most of the adaptive decision making 
elements. Calk are voltages through resistors charging inte- 
grating capacitors. Call urgency translates to higher voltage 
for a longer time thereby increasing the capacitor charge rate 
and amount. Frequency of calls is the number of times this 

60 charging takes place. A filter select threshold is initiated 
when the capacitor voltage triggers a voltage comparator. To 
prevent indefinite sensitivity enhancement, a time slot for 
decision making is created by a negative going current 
source which eventually discharges the capacitor to reset 

65 conditions. 

Each filter is engaged fi-om a comparator as above. 
However, when triggering and a filter change occurs, all the 
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integratiog capacitors for the other filter choices are dis- described in more detail later They are all non-linear 

charged and held inactive for a pre -determined setup and run processes and therefore should be used sparingly, 

time. Once completed the process resets and starts again The methods of transient reconstruction employed fall 

without prior memory. t^iree categories: 

Program conditions are recognized with building block S a. Waveform synthesis 

type analog circuits. High pass filters and peak detectors sort b. In-Between sample generation 

out alias causing high level upper frequencies. Peak and c. Slew rale compression 

average level detectors arc compared and the difference All of these methods rely on starting with an accurate 

response integrated to identify transients. To reduce the waveform of the transient resulting from an oversampled 

influence of program level variations, voltage controlled lO original signal which has the higher frequency information 

amplifiers servoed from RMS detectors are used to scale the intact. In the waveform synthesis method, a transient to be 

peak-average operation. Each of these circuit groups then reconstmcted is identified at the encoder, and it's wave 

produces a positive going averaged output voltage whose shape is matched to one of a number of predctermmed 

amphtude and time duration is related to the degree of filter "standard" transient shapes, which are known to both the 

compromise, or the desirabifity of choosing a particular filter 15 ^^^coder and decoder. A command code identifying the shape 

type Strong high frequencies, fast peaks al various program ^ f ^""f^ channel to the decoder, which 

, J . . « 11 • . n . . regenerates the shape, either by reading it out of a lookup 

levels, and high overall average intensity aU convert to ^Jj^ algorithmicaUy generating it, and scales it to the 

similar filter call voltages, each proportional to the magni- amplitude of the bandlimited transient arriving in the main 

tude and repetitive nature of the program event. ^-g^^^ ^^^^^^ synthesized waveshape to 

Filter Switchmg and Merging 20 correct the shape of the transient and approximate the 

Filters have different lengths, instantaneous phase shifts, original. The correction can be in fonn of a difference 

time delays, responses etc. Simple brutal switching from one between the band limited transient and the original, which is 

filter to another would create serious glitches, and other very added to the band limited signal at the decoder. Obviously, 

audible disturbances. Some form of time alignment, fading only a limited number different corrections can be used, 

and merging or a parametric change within the filter from 25 since one must be chosen in a reasonable time at the encoder, 

one type to another is necessary. All of these techniques have all of them must be remembered at both ends, tokens must 

been done in both analog and digital filter changing. Early be assigned to designate the choices, and time is required to 

light bulb photo-ceil and VGA type fader-switchers are synthesize and scale the correction at the decoder, 

common analog methods. Many digital synthesizers use Nevertheless, it is possible to achieve an apparent increase 

mix, merge and parametric filter changes in various combi- 30 in available bandwidth with only a few shapes. This method 

nations to produce inaudible transitions. Good examples are has no compromise to the shape of the bandlimited signal 

Fairlight and Synclavicr machines which have elaborate except the presence of the control command, and therefore 

digital tracking filters which work on these principles. is not audible on non-decoded playback. 

A simple implementation would use LED photocells and The in-between sample generation method is very similar 

time delay correction to switch filters. For more advanced 35 to the above, except that instead of sending a token repre- 

versions, the filters are implemented using DSP programs, senting a remembered correction, the encoder sends the 

and DSP programs are used to perform the mix, merge, and actual waveform correction over the control channel, spread 

coefficient changing functions. out in time to accommodate the low bandwidth of the side 

4. Frequency response limitations imposed by industry channel. In it's simplest form, this correction can be the 

standard sampling rates 40 value of a single "in between" sample point falling between 

The frequency response of digital systems is fundamen- the normal samples of the band limited signal. The decoder 

tally limited to half of the sampling frequency, in accordance can use this point to correct its interpolation of the signal as 

with the Nyquist theorem. For a current digital recording it generates an oversampled signal prior to conversion back 

media, Compact Disc, this means that one cannot record to analog form. As above, the only effect on non-decoded 

anything above 22kiloHertz. This limit was chosen based on 45 playback is the presence of the control channel, 

the assumption that the human ear cannot hear sounds above The slew rate compression method is different from the 

about 20 kilohertz. Recent research has shown, however, above two in that the additional information required to 

that humans use transient information in sounds with fre- construct the transient is spread out in time and sent as part 

quencies much higher than that to determine the direction of the main signal. The control channel is used simply to 

from which the sound has come, and that eliminating those 50 activate the process. This method is conceptually similar to 

very high frequency components impairs ones ability to a technique used to enhance the apparent bandwidth of a 

locate the source of the sound. The inner ear actually has video monitor during transients by slowing down the scan 

nerve receptors for frequencies up to about 80 kiloHertz. rate during the transient and speeding it up again to make up 

Therefore, if the '"brick wall" low-pass filter, which is a the lost tune. When the slew rate, or rate of change, of the 

necessary part of all digital recordmg, removes frequencies 55 waveform exceeds a threshold, it is limited to a value which 

above about 20 kiloHertz in transients, it reduces the level can be represented accurately in the band limited signal. The 

of realism in the sonic image. degree to which the speed is slowed down is scaled to the 

In accordance with the invention, the wave-shape of speed of the original transient so that the decoder can infer 

critical transients is reconstruaed at the reproducer based on the original slew rate from the slow one which it can observe 

information sent from the encoder over time. The steady 60 in the recorded signal and speed up again. Since the transient 

state bandwidth of the digital channel is set by the industry is spread out in time, the time must be made up somewhere, 

standards, but, for occasional transient events, additional normally afterwards. In order work properly, the transient 

information on the shape of the waveform can be spread out must be isolated so that information near it in time is not lost, 

in time and sent along for use by the decoder. There are a This method definitely does have sonic consequences for 

number of different methods which can be used to accom- 65 undecoded playback, but analog tests indicate that a surpris- 

plish this, all of which make use of a control signal or "side ing amount of slew limiting can be done without being 

channel" of information sent along with the main signal, objectionable. 
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Dynamically controlled systena 

All the above improvements are most effective when the 
reproduce decoder changes to complement conditions of the 
recorded program. The record encode process can generate 
a hidden control code concealed in noise as one method of 
controlling these activities. Random modulation of forbid- 
den numbers in an error correction code or user code is 
another way that the control codes can be included with the 
program data. These can be continuous or initiated when 
needed. When the code hides in the program, digital copies 
from one format to another will preserve the code whereas 
analog copies will not. These features can identify unautho- 
rized copies, as well as convey production process informa- 
tion that might be used for motion picture work, etc. 

Algorithms and lookup tables in the decoder provide 
curvature shapes, time constants, level thresholds, 
multipliers, filter coefficients and other useful data also 
"known" by the encoder. Without continuous control 
information, the system can run default where the recorder/ 
encoder is set up to anticipate the reproducer response. 
Either feedback from an internal test for best encoding or 
feedforward of a previously worked out response will do 
this. Most control activity is needed to access and change a 
particular complementary reproduce function or correction. 
Hence the improvement is much greater than the informa- 
tion bandwidth loss necessary to make the improvement. 
5. Digital to analog and analog to digital crosstalk 

The smallest analog signals, in the 100 microvolt range 
and under, are easily contaminated or interfered with by 
digital data streams having millions of times greater energy. 
Faster processing increases the energy per bit as well as the 
number of interferences per second. The same situation 
occurs with larger numbers of bits. Interconnects, cables, 
and enclosures pick up this energy, store it, and create 
delayed compound interactions. Higher speeds require 
smaller packaging which increases such crosstalk, unless 
wires and other parts are also made smaller. 
FIG. Sb 

Analog waveform changes occurring from digital inter- 
action. 
FIG. 5c 

Sample and encoding errors from rapidly changing wave- 
forms. 
FIG. 5d 

Sample and encoding errors from low level waveforms. 

In accordance with the invention, a silent conversion 
system is used to resolve the above problem. 

Normally a digital system operates with a continuous 
clock which times its internal operations. MUUons of timed 
events occur each second. Hence the system state may 
change or be in a state of change at any moment, particularly 
the critical sample time when high accuracy is needed most. 
Sample time jitter and digital to analog crosstalk may result. 

The system of the present invention stops all operations 
long enough before sampling to allow the energy stored on 
cables and other energy storage parts to dissipate. One pulse 
initiates sampling which then occurs during electrical 
silence. Once signal capture is complete, other processes 
resume. 

A number of prior art approaches have been developed to 
reduce some of the above distortions and are described as 
follows: 

1, Group delay of low pass filter accomplidied by using 
an all pass phase shift network. 

2. Quantization noise reduction from use of 1 or 2 least 
significant bits *1ceep alive" ultrasonic dither. 
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3. Reduced granularity noise from use of balanced or push 
pull circuits, achieving high common mode rejection of 
noise spikes and digital-analog crosstalk. Further 
reductions made with optical isolation of logic and 

5 converter systems, as well as high impedance isolated 
power supplies. 

4. Slew induced errors reduced by super fast symmetrical 
analog circuits. 

These improvements help reduce the harsh, congested 

10 sonics, and may slightly expand spatial sense in good 
recordings. However, inner detail and correct space perspec- 
tive are stiH lost even with such prior art approaches. 

Referring now more particularly to FIG. 8 of the 
drawings, there is shown a processing system, in accordance 

15 with the invention. The system modifies signals to achieve 
18 bit performance from a standard 16 bit converter system. 
As mentioned previously, the average level of very small 
signals is expanded while the occasional instantaneous 
peaks of very large signals are soft limited. When both 

20 operations are carefully done and are digitally encoded and 
then reproduced in a standard manner without decoding, the 
sound is improved. Ambience and articulation more like the 
original program does occur, even though the process would 
be audible without the intervening analog to digital and 

25 digital to analog conversion. By the time this expand limit 
process becomes clearly audible on standard equipment, the 
dynamic range for fully decoded reproduction in accordance 
with the invention has increased almost 20 dB. Average 
resolution is substantially more than 18 bits. 

30 Each numbered subsystem element in FIG. 8 is an impor- 
tant stand alone operation typically performed by an inde- 
pendent circuit card or module. The corresponding sche- 
matic circuits for implementing the system of FIG. 8, while 
deemed to be within the design purview of one of ordinary 

35 skill in the art, are included for convenience in Appendices 
A, B and C included with this specification. These circuits 
are numbered to correspond to their respective block func- 
tions in FIG. 8. 
The small signal average expand subsystem 61 operates in 

40 the following maimer. The incoming audio signal is band 
restricted to 5 Hz to 500 kHz, thereby preventing DC level 
shifts, supersonics, and radio frequency components from 
overslewing amplifiers and influencing process control 
parameters. Components CI, LI, Rl, CI and R2 and buffer 

45 follower components J211 and J271 in Appendix A perform 
this inside-outside world isolation. Two active signal paths 
are provided, one passing through a voltage controlled 
amplifier (VCA and ICl) and the other originating from the 
buffer. Both signals are in phase, however, a control signal 

50 marked "compensation input" can set the VCA output from 
-40 dB to weU above the buffered output. 

Since VCA devices are well-known distortion producers, 
this configuration allows the clean buffered signal to pass 
uncontaminated when the VCA is shut-off at it's -40 dB 

55 gain. Only during very small signal conditions, when dis- 
tortions are less important, is the VCA gain made large, 
allowing its substantial output signal to be added to the 
buffered signal. A higher overall output results. Remaining 
circuit components perform housekeeping functions neces- 

60 sary to prevent crosstalk between control signal and VCA 
output and to adjust for lowest distortions. 

The phase shift network subsystem 62 operates as fol- 
lows. The buffered and VCA signals summate or combine in 
phase at an attenuator Rl R2 R3 in Appendix A, With 

65 average program signals in the 0.05 to 0.5 volt (0 to -20 dB 
range), the VCA gain is set at -40 dB , making its output and 
distortions inconsequential to the accurate buffer signal. 
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VGA gain increases substantially for small signals in the limited and IC104 generated supersonic and near supersonic 

0.005 and under (-40 to -80 dB range) where monotonicity noise to dither the A to D conversion, 

and discrete step-by-step type quantization errors from the Completion of low pass filter compensation includes a 

AD-DAprocess are becoming increasingly large. This added combined notch— peak circuit around OP amp IC103. A 

VGA output maintains a "keep alive" status or minimum bit s tuning of 18.5 kHz high Q partial notch and a 21.5 kHz sharp 

number change rate at the A to D converter. Here the signal become added filter sections which help smooth and 

and its background noise become dither and a minimum reduce ringing. A rougher, but acceptable, frequency 

useful amount of it is maintained by the variable gain VGA response is made and the peak transient ripple is less than 

independent of signal conditions. Sometimes noise dither is 5% wit^ completion the same as the square wave risetime. 

added to digital systems and in practice this noise is quasi- lo ^^^^^^ gaan structure and source unped- 

audible. The active-dynamic didier has similar properties '^'f^^^ diodes made from transistors Ql ^d Q2. 

, ,, . . J J ,1. • • 1 J • These can be "supermatched pairs having many devices 

excep. mai wnen neeaea, ne original program aynamics can ^^^^^ connected on IC substrate vieldine near ideal iunc- 

be restored with a ^ntrolled playback VGA system, (i^n performance. Circuit elements include simple transis- 

Foursectionsof aU pass phase shift correcnoQ circuits and j^^^ behave close to the ideal logarithmic junction 

a second buffer are placed m the signal path. These stages 15 relationship of: 
marked A, B, are twice iterated. Each section of J557, J211 
and J271 is connected to make a unity gain buffer — inverter 

giving in phase signals at R5 and 180 degrees out of phase Vi-^i — ^ logn— 
signal at R4. Both signals combine through Ra and Ca 

making a flat response aU pass system having near 0 degrees 20 -^^ ^^^^ ^^^^^ ^^^^^^ ^^^^ 

at low frequencies and 180 degree phase at high frequencies ^^^^^^ temperature, and electron charge are 

The four combined sectior^ still has flat frequency response considered constant. Instantaneous resistance of dV/dl (rate 

yet exhibit an abrupt 720 degree phase shift m the 5 kHz to of change of voltage to current) becomes related to 1/cunent 

30 kHz region. This corresponds to a 400 uSec group delay once limiting action begins. This relationship tracks over a 

change which partially cancels a sudden group delay shift 25 40 dB (100 times) range for reasonably good transistors 

occurring with elliptical low pass filters. Without thereby allowing easy record— play peak signal tracking in 

compensation, serious transient ringing would ripple modu- the 10 dB one to two bit process range. A practical setting 

late on and off the subsequent peak level limiter and would is a 2.4 volt peak to peak triangle wave compressed to 1 .2 

cause excessive gain modulation at the reproducer restoring v peak through Ql, Q2 yielding a 3.5 v pp output at IC102B. 

or expanding the signal peaks. The group delay filter has 30 This 1 bit (6 dB) compression can be monitored at "test" 

very little ringing and allows much more predictable peak output showing the clipped portion which for set-up adjust- 

limit and expand operations. ment is made symmetrical with the 50 k ohm control. 

The low pass filter subsystem 63 (701 filter) operates in Restorative operation is demonstrated by connecting IC102 
the following manner This is an essential and very trouble- out to IC106 in. Observations at IC103 "protect^* output 
some part of all A to D converter systems. It stops or rejects 35 shows tracking ranges in excess of 20 dB when needed, 
frequencies near and above the Nyquist limit or Vz sampling Operation of the analog to digital conversion subsystem 
rate. For idle systems, its "stopping: action must be better 65 and digital to analog subsystem 66 is as follows: Output 
than the least bit resolution, while its pass action must be reconstruction from the D to A signal must occur prior to the 
ripple free and in proper phase alignment in the 15 Hz to 20 low pass filter subsystem 68, otherwise phase shifts would 
kHz range. At 44.1 kHz sampling and 16 bit encoding for 40 alter the signal waveshape and consequent expand threshold 
Compact Disk formats, the filter must drop at least 85 dB points. Consequent sampling feedthrough currents, and 
between the 20 kHz audio limit and the 22 kHz Nyquist interferences as well as step sampled date require fast 
limit. Mathematics of traditional filter designs require com- circuits. Amplifiers have additional stabilization and speed 
promise decisions related to numbers of parts and their enhancement. Components marked Rs Cs perform these 
signal degradation, and alias, group delay, and ripple com- 45 operations and arc specific to the amplifier types used. With 
promises. For the system of FIG. 8, a compromise of more decoded step waveforms, the limiter function must quickly 
parts for better transient and group delay is taken to allow settle to each level and associated amplifiers must not 
better peak limit — expand operation. The delayed high fre- overshoot, ring, or have unsymmetrical rise and fall times 
qucncy part of a sweep, which happens first, can add or while doing this. As noted, limit — expand functions must 
subtract from lower frequency parts of the sweep happening 50 occur at direct coupled or DC pass circuits not having phase 
later. Thus, the instantaneous frequency response can change shift. A to D inputs and D to A outputs satisfy these 
with fast changing signals. Ripply beats throughout enve- requirements when the low pass filters are not included in 
lope and "tail" occur when such a sweep repeats back to the path. In practice, limiting will create upper harmonics in 
highest frequency. A shortened envelope also occurs as the Nyquist range which could create alias noise which 
delayed high frequencies of uncompensated filter occur 55 would confuse reproduce reconstruction and add consider- 
within the sweep envelope. In this regard the delayed high able distortion. Fortunately, practical operation allows mod- 
frequencies continue ringing and intemaUy reflect within the est compression and expansion of occasional peaks which 
filter after the sweep envelope has completed and started the happen in music and speech program material. Unlike 
next cycle beginning well above the filler cut-off. instrumentation signals of constant amplitude maximum 

The high level peak limiter subsystem 64 (limiter, 60 energy to band edge character, upper music frequencies are 

expander, dither generator) operates as follows. ICIOI in usuaUy harmonics of less energy than fundamental tones. 

Appendix A receives the filter output and completes tran- Alias foldover is then infrequent and occurs only at peaks 

sient response ripple compensation previously mentioned. which best mask these problems. FIGS. 6fl-6/ show various 

Ql and Q2 with IC 102B perform the peak limit function signal waveforms during the limiting and reconstruction of 

while Q3 and Q4 with IC 103 perform the restorative peak 65 an illustrative triangle wave. 

expand function at the reproducer. Added parts IC102A The low pass filter subsystem 68 operates in the following 

allow one to observe the signal waveform peak that has been manner. The peak reconstructed sampled D to A signal 
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output of IC103 is routed to a simple low pass filter. The 44.1 
kHz and up step components are removed and the waveform 
is rounded and smoothed inherent to the filter characteristic. 
Noise and transient spikes are reduced to tolerable levels to 
prevent overslewing the VGA portions of the low level S 
signal compress circuits to follow. 

Operation of the small signal average compress buffer and 
VGA subsystem 69 and Line Amplifier Subsystem 70 (small 
signal compress, line drive) is as follows: Both subsystems 
serve similar functions to their subsystems 61 and 62 lo 
counterparts in the record section. Buffered and VGA output 
voltages are similar. However, this time the VGA output is 
subtracted. As before, lower distortion is achieved by oper- 
ating the VGA at -30 to -40 dB level relative to normal level 
signals. The output line amplifier is connected at differential 15 
input single ended output. Increased VGA gains reduce 
signal outputs until at +10 dB, a null or 0 signal maximum 
compression occurs. With this arrangement, any reasonable 
signal expansion can be compensated and the system dis- 
tortion is lowest for the most probable average level signal 20 
conditions. 

Control signal generation is accomplished by the limiter- 
buffer subsystem 71, bandpass filter 12a and RMS detector 
subsystem 12b and gain subsystem 73. High level peak 
hmit — expand thresholds and low level average gain set 25 
controls are needed. Circuit settings allow both types of 
control to be tested independently of each other. Best 
operation occurs when the control signal anticipates the 
program waveform to be processed and, hence, an audio 
pre-delay is used to allow control stabilization prior to 30 
circuit action. Low control bandwidth is needed to minimize 
non-signal least bit activity. One method of doing this is to 
have active — ^inactive control status. Since high level — ^low 
level program signals do not occur simultaneously, the 
reproducer can make its own decisions as to where the 35 
control is applied. The unused operation then returns to its 
inactive or nominal process state. High level, normal pro- 
gram type signals, where expand — compress functions are 
unnecessary, then have inactive control status. As signal 
levels decrease, an internal Umit diode/clamp releases and 40 
the VGA gain rapidly increases to create summation signals. 

Further program level reductions modulate the VGA gain 
in a controllable, predictable manner needed to maintain 
digital "keep alive" LSB (least significant bit) activity. For 
most conditions, these lowest level signals will be mid-band 45 
acoustic noises and numerous types of electrical noises. The 
latter may include RF interference, light dimmer pulses, 
security system signals, and high frequency peaked elec- 
tronic noises. These often have low audibility compared to 
midband acoustic sounds. Hence, a sharp cut-off bandpass 50 
filter and very wide peak to average level capabilily RMS 
detector are used to assure that the control signal tracks 
audio sounds and not inaudible interference. 

In the small signal average expand subsystem 61, to 
handle the entire large dynamic range of modem program 55 
materials would require very low noise filters and detectors 
of quite difficult electronic design. Since the average level 
circuits arc low program level active only, the process gain 
can be very high. This allows reasonable circuit voltages to 
occur during quiet passages. Strong signals normally creat- 60 
ing overload are smooth limited with a semi-logarithmic 
curve to create minimal compression harmonics. Noise, 
transients, and other uncontrolled overload behavior are then 
prevented fi"om crosslalking to the signal path. Component 
IGl is configured as approximately 100 times small signal 65 
unity gain. Successive diode conduction with increasing 
voltage until the stage has less than unity under signals and 
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maximum output rarely exceeds 6 v peak to peak at maxi- 
mum program levels. 

The bandpass filter subsystem 12a prevents low level 
inaudible electronic noises from modulating the average low 
level process. The breadboard part covers a 200 Hz to 5 kHz 
range and is made from two sections of active combined low 
pass high pass feedback type filters. These have a slight rise 
at band edge firequcncies foUowed by a near 24 dB per 
octave cut-off. Note, that a front end buffer (J211 and J271) 
prevent filter impedance loading from interacting with input 
signals. 

The filter output drives an RMS detector module, a 
DBX-type component having an averaged DC logarithmic 
output relative to AG input. As configured, a 100 mV output 
change occurs for each 20 dB input signal change. This gain 
structure from the limiter and filter through the converter 
gives 100 mV control range with very little noise for the 
millivolt type signals occm-ring at least bit resolution limits. 
Levels on either side of this represent front end electronics 
noise and normal signal operation. 

Normal compressor — expander compromises are 
employed to assure minimal VCA gain modulation 
(distortion) from AG components in the control signal. 
Components CI, Rl perform this response averaging for the 
turn-off time constant. A much shorter tura-on time constant 
from the RMS module internal impedance and CI occurs to 
allow fastest response to sudden program level increases. 
The short — long time constant action is typical of compand 
systems and because of low frequency distortion 
requirements, is set very long. (20 msec on, 500 msec, off for 
20 dB gain change) This very slow response necessitates 
input signal delay to allow control signal buildup before 
sudden signals occur when VGA gain is maximum at low 
level signals. In practice, the delay adds considerable 
distortion, and would not be used in its analog form in high 
quaUty systems. 

Digital processors can perform all of the above level 
Umits, band restriction and detection. The needed time 
delays to get best performance are simple, first in first out 
type, operations. TVo advantages of long constant opera- 
tions occur. Low frequency distortion is reduced and control 
signal bandwidth is much less, thereby reducing the amount 
of bit borrowing needed to pass the control through the audio 
encoding. 

The DC offset and gain adjust subsystem 73 is the control 
signal amplitude, ofifeet, and limit nerve center. It adjusts for 
tolerances between amplifiers, delay lines, VGA's and the 
RMS detector and, hence, performs general circuit house- 
keeping functions. It also is a limiter to give maximum and 
minimum VCA gains needed to implement the control signal 
inactive and minimum input signal presets. 

For system considerations, both VGA's and the RMS 
detector operate with logarithmic control to signal and signal 
to control relationships. Hence, changing an ofEset changes 
a fixed program gain in dB. This makes possible large 
dynamic range gain control and yet still maintains low level 
signal control Both can occur with reasonable control signal 
limits. In addition, control system gain changes, such as 
Umiting, give direct dB to voltage gain ratios making very 
simple compress — expand ratios and assuring input — output 
tracking by simple polarity reversal of the control signal. 

The offset gain adjust circuit inverts the control signal for 
input output tracking, adjusts DC offset of each to match 
gains at a pre-determined control signal level, and has 
control gain adjusts to make program level increases match 
reproducer gain decrease for varying control levels. Diodes 
CRl and GR2 perform level limits to preset a maximum 
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practical expand ratio and a maximum compress ratio imder 
playback. As constructed and configured, this circuit has 
compress — expand ratio adjustment interactive on a single 
control and the threshold of when the process starts on a 
second control. Since these are DC level of dB operators, 
process control signals to these points will create dynamic 
process changes. At present, this is a manual adjustment. 
However, the process start level can be change dependent on 
program activity and other considerations to reduce audi- 
bility with normal non-process playback. 

The delay line subsystem 74a&b is a balanced DC 
coupled self -clocking variable delay line. Charge coupled 
devices are operated push pull with staggered clocking to 
make the lowest possible DC drift, distortion, and clock 
noise from relatively poor performance devices. DC to 25 
kHz minimum overshoot, 80 dB dynamics are achieved. 

One delay 14a is used to allow control signal stabilization 
to prevent VCA overload from sudden signal changes. This 
delay also allows anticipatory process control signal strategy 
to be computed. A second line 74b is for test purposes when 
using a system without the hidden code subsystem to match 
the A to D and D to A encode-decode process time to make 
output signals track inputs. Bit boaowing, in which the 
control signal is noise encrypted and hidden in the least 
significant bit or bits of the digital signal, is the normal mode 
of operation of the system. 

Limiter dynamic control via VCA input/output tracking 
can be had at high signal levels by removing the limiter- 
buffer subsystem 71 and operating the system as a straight 
compressor-expander. Since the peak limiter-expander is 
within this system, its operation is changed along with the 
gain variation programmed with the ofifeet gain adjust sub- 
system 73. As noted before, a process control input can be 
operated so that all times when signals arc loud, a certain 
percentage of hmiting takes place. This is program depen- 
dent as some classical music will have infrequent peaks 
while studio processed rock and roll is more likely hard 
limited and will have many small peaks occm"ring fre- 
quently. Although this threshold control may be accom- 
phshed manually, numerous computed variations will work 
more effectively to keep the process least audible when 
reproduced on a standard non-restoring player, just as in the 
case of the low level process dynamic control. As with the 
average level expand-compand, the limit expand threshold 
control need only be very low bandwidth. A 10 Hz control 
bandwidth is adequate and since only one operation occurs 
at a time, only one control for both operations is needed. The 
player can determine program level and switch functions. Id 
the illustrative system described, the control is manual since 
each operation is a different set-up. However, there is no 
foreseeable difficulty in making this automatic if duplicate 
VCA's were set up for limiter gain stmcturing. 

The following further describes the theory, design 
concepts, and early development, construction and operation 
of an encode-decode system demonstrating the basic prin- 
ciples of the present invention. Its operation is analogous to 
the reconstruct process based on choosing optimal curve 
fitting techniques to get best waveform reconstruction. As 
described, the process changes for different signal condi- 
tions and the number of such process optimizations per unit 
time can range from a few per program to many times per 
second. Even faster operation changes are possible. 
However, the control signal needed to access the proper 
operational program becomes more complex and bandwidth 
constmiing. 

The basic system contains two record processors and two 
decode processors, each of which is complementary to and 
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matching as a system. Either system is selected automati- 
cally by variable resistance photoconductive cells working 
as slow faders in the signal path. Light emitting diodes 
illuminate these cells and are driven by variable level control 

s signals emanating from a signal analysis logic circuit. Dur- 
ing operation, the logic chooses the least distortion process 
based on signal conditions. Similar switching and routing 
can be accomplished with voltage controlled amplifiers, 
digital attenuators, and field effect devices or other compo- 

10 nents acting on the analog signal. Similar routing, mixing, or 
merging operations can be made from digital processors 
operating on numbers representing the signal. Such opera- 
tions like those with the photoconductive cells can be 
transient disturbance free by virtue of their slow switching 

15 action. Each record process, and its complementary repro- 
duce process resembles a filter-equalizer operation which is 
made optimum for the program signal. Both parts operate as 
a system so that the encoder can anticipate reproduce errors 
and can create complementary corrections. In this manner, 

20 the record and reproduce circuits are not working as an 
individual, stand-alone theoretical ideal, rather as an optimal 
system. The breadboard design has two such systems, one 
for best articulation and transient response and the other for 
lowest distortion. 

25 Filters, equalizers and curve fitting operations are accom- 
plished as follows. One can define a filter mathematically by 
coefficient strings in polynomial sequences. In addition, the 
same filter can be defined by how it responds to a given 
waveform stimulus. Essentially, curve fitting in time, fre- 

30 quency domain, and amplitude is created from numbers 
which can be stored in tables. For analog systems, such 
operations are performed by circtiit elements connected to 
band restrict, equalize, lime correct, and to perform disper- 
sion operations on a signal. These circuits can also be 

35 analyzed back to similar polynomial coefficients which can 
mn as digital process programs. As can be seen, very 
awkward circtut constmction problems occur when one 
must alter these numbers from time to time, as would happen 
with a dynamically changing process. Multiple component 

40 values of inductors, resistors and capacitors, as well as gain 
stages, would be aU simtiltaneously changing to produce 
such a merge operation. This can, however, be accomplished 
by digital programs. Dynamically changing digital filters 
have become practical only recently as the necessary pro- 

45 ccssing power has become economically available. Of 
course, simple networks such voltage controlled parametric 
equalizers and variable RC section tone controls have been 
available for a long time. However, complex variable filters 
are still rare. As one can see, the dynamically changing curve 

50 fitting operations can be handled most directly by digital 
processing. In an analog system complete filters mtist be 
changed, whereas the digital process merely changes filter- 
ing. Both have similar potential curve fitting capability, 
however, they differ during the transition region from one 

55 process to another 

In theory, only one set of filter coefficients is needed to 
make a near ideal analog to digital conversion and its 
reciprocal, provided all signal activity in the frequency 
domain is greatiy removed from the Nyquist sample limit 

60 and there are ample numbers to characterize the signal. 
Commercial digital standards do not allow either of these 
conditions and, consequcntiy, some practical state-of-the-art 
compromise of time, transient, alias, quantization, and flat- 
ness of response must be made. The best of each perfor- 

65 mance aspect caimot occur simultaneously and one of ordi- 
nary skill must choose a compromise based on knowledge 
and subjective experience with audio programs. 
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As previously indicated, the signal to noise ratio of digital Since digital process timing is almost always crystal 

processes can be excellent while complex distortions at controlled, the record — play transitions can be made to track 

average sigaal level can be higher than with good analog each other by pre- timed sequence programming which can 

systems. For high quaUty work, there is a need for improved be initiated by a single command. This eliminates the need 

resolution, time and transient accuracy as well as reduced s for continuous numeric control and higher bandwidth for the 

high order distortion. This aspect of the encode-decode control signal. All process types, transition speeds, and 

system, m accordance with the present mvention, addresses intermediate coefficients can be stored and run as a program 

such a peed. , . ^ . ^ - from a single, one time command and the recorder- 

At this pomt, a fiirther understanding of digital distortions reproducer are effectively locked to each other, 
will prove useful. Typical digital systems have between 0,01 tt. . • , . ■ , *j 
and 0.05% total h^mooic distortion (THD) at high signal ^''^.>,'°'^u^ ';^sistor.capaci or tmie 
levels and about 10% cumulaUve erroi^ in the time-transient T"^"^ threshold sensing logic o simulate pre- 
domain. Most analog systems have opposite problems to determined transition speeds and the resultant trackmg of 
these, as they often operate at above 1% THD but seldom intermediate filter mix states. In addiUon, other time con- 
have more than 0.1% transient time error. Under low to stants also serve as internal memory to add hysteresis or hold 
average signal conditions, digital THD increases while ana- ^5 back to decision making operations. These allow a first time 
log THD decreases. As noted, digital distortions tend to be Q^ck process change decision and a reduced sensitivity to 
upper order and non-harmonic and, therefore, stand out due further changes thereafter until the time constant resets. This 
to their non-musical nature. Analog distortions occur less prevents unnecessary process changes during grey area or 
frequently and are less objectionable, even at higher levels, uncertain signal conditions. Like a digital system, the analog 
as they tend to blend in or musically merge with the signal. 20 system has the ability to operate with simple switch on 
Similar problems occur with transient time domain type switch off control where the output tracks the input and 
distortions. At first, it was thought such problems were where the output or reproduce subsystem does not have to 
inaudible, since simple square wave tests would show few detect signal conditions to do so. 

sonic consequences from such distortions. Today, we can Normal analog systems are not DC or direct coupled as is 

show serious deterioration of spatial sense, as well as lost 25 the case with digital, and these would require an additional 

inner detail perception as a result As digital time domain ^^ta channel with a linear control signal or an internal analog 

distoruon is much more complex than the simple ringing ^. j conditions detector to make such a system opera- 

TT'^ 1 fu'f^ '."'^/^^f ^ performance of industry ^^^^^ ^^^^^^^ operation, the basic analog system has 

standard 16 bit encoding IS also inadequate. A system which , » * j m, • j Jjj a ♦ 1 j *u- j 

, 1. 1 1 1 • 1 '11 1. been tested without buried or hidden code control and a third 

can produce 10 volt peak to peak Signal wiu have approxi- ^ 1 . 1 j 1 i_ l 

mately 150 uV b J possible rescdution from one least control "^h^n^el with appropnate tune delays has been 

significant number step to the next. Practical systems have ^ ' , . . t . • i , 

signal discontinuity of 4 to 8 times greater than this, as the There are numerous ways to sneak through and hide the 

state-of-the-art has not yet allowed near theoretical perfor- ^^^^^^^ signal withm digital systems. As previously pointed 

mance. A 20 to 50 uvolt discontinuity limit is typicaUy can random noise encode-decode a control signal in 

considered just audible. Practical systems have distortions ^5 the least significant bit(s). This operation has no counterpart 

often ten times higher than this. in the analog domain as it is nearly impossible to locate 

As noted earlier, the peak signal limit-expand and low minuscule portion of a complex waveform carrying this 

level average expand-compress operations deal with reso- information. In the digital realm, the least significant bit 

lution problems. Other distortions from time shift, alias, and activity is always known. Hence, this bit can actually be 

quantization, which are inherent with even ideal encode 40 borrowed for control purposes. Other ways to hide a control 

decode operating to industry standards, still remain, signal include using forbidden numbers or imused data 

Distortion reduction may be accomplished in the follow- words or number strings within a digital system which the 

ing manner. Most digital distortions can be predicted, as they same or a different system considers an error or nonexistent 

are strongly related to signal conditions which are easy to data. When the forbidden numbers are carefully chosen 

identify. It follows that, for a given signal, one can choose 45 during encoding, the reproducer wiU recognize the error, but 

a best encode-decode process having the least audible or still decode its data signal correaly. Of course, the forbidden 

sonically damaging distortion. If one must operate to indus- number is data which can be extracted and used for the 

try standards where the Nyquist limit is just outside the control function. Either method of concealment has enough 

audio range, then a transient response versus alias compro- bandwidth within Compact Disc standards to allow ample 

mise exists. This compromise occurs when requiring fiat 50 bandwidth or information carrying capacity to pass complex 

passband response and a very narrow pass to reject transition control signals. Any signal degradation from performing this 

bandwidth. As the signal changes, one can choose the best operation is very small when compared to the improvements 

process. residting from the added process power and re -construction 

In practice, phase and time response are not equal firom capability being controlled, 
one complex filter-equalizer network to another and a slow 55 Present industry standards are largely based on providing 
fade or merge is needed to prevent inevitable switching good performance in terms of flat response, low harmonic 
transients with process shifting. Similar problems are dealt distortion, and high signal to noise ratio. Time, transient, 
with for analog noise reduction processors. With digital alias, and resolution are compromised, but their problems or 
processing, these operations of merging from one optimum deficiency occur predictably with signal conditions, 
filter or curve fit to another can be lookup table coefficients 60 Consequently, a control logic must analyze the incoming 
which are accessed as a sequence to merge from one filter program material and determine a best process, 
type to another. While phase anomalies stiU occur, the The relatively simple basic analog system circuit makes 
decoded signal can, however, be free of beats or cancella- quite accurate decisions of quantization versus alias distor- 
tions which plague analog fader type systems. The mix or tion based on high fi'equency intensity and its ratio to 
filter change merge occurs just fast enough to prevent 65 average program level. This follows from the flat frequency 
audible transients or other parametrically generated phase response -sharp cut off compromise of the low pass filter 
disturbance. design. In practice, the filter must be 85 to 90 dB down at the 
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end of its 2 kHz transition region. Just prior to this, it must 
be flat to 20 kHz. Unfortunate and serious transient ringing 
must occur, as can be demonstrated from the analysis of a 
square wave with its upper harmonics sharply removed. The 
filter having good transient response will not remove enough 
alias causing upper frequencies. 

Live program spectral energy, in the transition region and 
above, is unpredictable and ranges from bursts caused by 
microphone element peaks, instrument overtones, amplifier 
distortions, etc. Hence, a simple high frequency level detec- 
tor can determine whether added filtering for alias reduction 
is needed or not. Since these distortions can be covered up 
by program sonics, an added weighting factor of reduced 
rejection during high program levels can be used. Therefore, 
the detector looks for ratios of high frequency Nyquist 
energy to average program levels to determine when more 
aggressive filtering is needed. 

Essentially, a reduced second derivative around the cut- 
off slope yields improved time and transient performance. It 
is assumed that symmetrical filters having constant group 
delay are used, as they are practical analog and digital 
process types. These have symmetrical pulse behavior and 
can be made to mix/merge from one curve fit shape to 
another without altering group delay and creating excess 
phase interference during transit time. Practical systems can 
have as much as 200 uSec. time shifts near cut-off when full 
90 dB alias rejection occurs. These numbers relate to about 
0.15 inch rapid displacement or doppler shift of high fre- 
quencies which can occur very rapidly with music type 
waveforms. Certain types of transient intermodulation dis- 
tortion (TIM) can occur under similar conditions. When 
corrected to 3 uSec/kHz change of upper passband 
conditions, a filter may have less than 50 dB rejection. 
However, as can be seen, a best choice compromise swit- 
chable system is practical. 

A second group of compromises relates to quantization 
distortions and the smallest signals which can be processed. 
As noted, level change operations reduce these problems in 
a compatible manner. Some further improvements can be 
made by anticipatory forced resolution enhancement. Like 
the alias/transient operations, these are also curve fitting in 
namre and can be accomplished by record-play circuit 
systems resembling equahzing filters. In this case, a forced 
high frequency extension during record is made when sig- 
nals have small amounts of high frequency information. 
When normal signal levels with high frequency content are 
present, the frequency response of the system is flat, but 
when the signal level is low and there is little energy in the 
high part of the spectrum, the frequency response in the 
record half of the system is boosted. The play circuit does 
the inverse operation. The overaU least significant bit activ- 
ity is substantially increased and more information becomes 
encoded via duty cycle modulation and increased dithering. 
When the record equalization (EQ) contour rises very 
sharply, most of this added information is just at and sHghtly 
beyond audio range. It has little effect on standard players or 
on hearing, because hearing acuity is low for these small, 
low level signals. Essentially, one has traded non-harmonic 
distortion for a similar amount of harmonically related 
program distortion. To a degree, the less accurate the player, 
the better this process works to disguise grainy noise as 
upper music harmonics. 

Of course, a decoder can be instructed to perform flat 
response reconstruction and there would then be more data 
bits making the complete signal Hence, quantization noise 
is reduced. This is another curve fitting operation which 
might be called dynamic dither, as it must be removed in the 
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presence of strong signals. If left continuously on, alias or 
beat frequencies will occur from strong signal harmonics 
interacting with such excess energy high frequency dither. 
Clearly, the process must shut-off under intense high fre- 

S quency conditions where resolution benefits become minor. 
Control signals for resolution enhancement and distortion 
reduction processes can be derived by looking for critical 
energy in the alias frequency range. High ratios of these high 
frequencies to average signal conditions are indicative of 
possible foldover distortions made audible as they are not 
masked by program material. 

Most significant are complex high frequencies by them- 
selves such as those encountered with cymbals since low 
frequency problems are completely unmasked and are 
audible 60 to 80 dB below where hearing acuity is strong. 
Such signals and how fast they change can be sensed to 
determine a best process. Quick high frequency bursts above 
average level conditions suggest least filtering and best 
transient response, provided some midband energy in the 
predicted alias range is present. Low levels of high fre- 

20 quency energy suggest quantization or dynamic dither cor- 
rection. 

Since some process/filter/equalizer coefficient change 
operations can be more audible than others, some maximum 
number of changes become part of the decision making 

25 process. Dynamic dithering and resolution enhancement 
(EQ) are simple high frequency operations which can be 
turned off and on rapidly without sonic consequences from 
sudden phase shifts, beats, etc. Transient alias switching is 
much slower as time-phase changes do occur. Because of 

30 these possible process to process time change constraints, it 
is necessary to look ahead to observe the before and after 
signal conditions surrounding the decision point. In 
addition, the occurrence frequency of these changes, past 
and present, is important to prevent process hunting or 

35 decision instability resulting in unnecessary process 
changes. 

Circuits to perform decision making are deceptively 
simple compared to what one might expect from the afore - 
described functional descriptions and the same holds true 
40 when the circuit equivalents operate from digital systems 
programming. The basic analog system uses analog circuit 
subsystems to perform these operations. These include, 
delays, voltage comparators, spectral analyzers, multipUers 
and signal detectors with time constant memory. High 
45 frequencies are detected and routed to three voltage com- 
parators. One is set to detect minimum HF thereby switching 
on dynamic dither. The second is set to maximum allowable 
HF to switch on the large anti-alias filter. The third has a 
variable threshold dependent on program level. Each com- 
50 parator has its own time constant or hold-off, so that, once 
fired, or its on-off state is changed, then a certain time must 
lapse before the circuit will respond again. In practice, these 
time constants are performed by diodes charging resistor 
capacitor networks and, as configured, the charge to dis- 
ss charge time can be easily made unsymmetrical. This behav- 
ior allows quick decisions of a "one shot" nature without 
having the circuit jump from state to state from near thresh- 
old conditions. Lamp/LED sources illuminate signal steer- 
ing photocells to give quick fades from one process to 
60 another. As with the comparators, the lamp drivers for each 
process type have different on-off time constants to accom- 
modate time-phase differences from one process to another. 
In addition, several time delays are used to allow logic 
action to happen prior to the signal conditions requiring the 
65 change. 

Unlike analog noise processors which reqtiire record-play 
tracking and very carefully worked out signal thresholds, the 
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basic analog system process decisions can be very rough. 
Accuracy is unnecessary as the reproducer process is always 
tracking. Since the operatioas are industry standard 
compatible, no major disaster will occur from a wrong 
decision. Hence, the analog circuits in the basic analog 
system have worked "as is" without refinement. 

It is clear that when a digital signal and process is used, 
the encoding must have greater accuracy and resolution than 
the final industry standard product. One method to assure 
this is to encode with added bits at a high sampling rate and 
then perform successive decimation and arithmetic roundoff 
or truncation to make the final format. (44.1 kHz, 16 bit) 
Processing becomes multiple stages of delays, filtering, 
equalizing, instantaneous gain changing and averaged gain 
changing. The signal is analyzed and the results are used to 
interrogate a process "rule book**. Several processes and 
their reproduce conjugates are available to be chosen based 
on predicted error and best signal reproduction. Once deter- 
mined and initiated, transition parameters are accessed and 
the process starts changing. During this decision making 
time, the music signal has been delayed to allow the process 
transition to complete prior to the signal being matched. A 
control word is generated and encoded for inclusion in the 
recording, so that the reproducer can access from its memory 
the complementary process and its synchronous transition 
parameters. Both operations commence relative to their 
timed sequences and to their stored data. Since the recorder 
has already simulated the pre-programmed reproducer 
action or the corrections for consequences of its action, both 
processes change synchronously within the time accuracy 
limits to the encoder-decoder crystals or clocks. The system 
then changes itself without having major transition aberra- 
tions and then operates with the best performance for the 
signal conditions. 

Referring now more particularly to FIGS. 9 and 10 of the 
drawings, there is shown a system which can choose an 
optimum recording process and its reproduce conjugate to 
achieve low alias or quickest changing, fastest settling 
transient response. Phase interferences during transition 
time are controlled by "fader" time constants and signal 
delays. The logic circuit has one comparator set up to change 
state when alias distortion would be greater than an approxi- 
mate 40 dB below peak program level. 

This circuit, shown in Appendix C included with this 
specification, contains four sets of back-to -back LED- 
Photoresistive cell switchers and driver circuits. Signals are 
delayed to allow process decision times and transition time 
constants are adjustable to allow smooth fading between two 
process signal paths. Controls arc derived firom an analysis 
filter and detector made sensitive to highest alias frequen- 
cies. A peak level detector sets a voltage threshold from 
which a comparator can be referenced. Alias components 
above this level setting will switch processes. A second 
program delay is used to synchronize record-play tracking 
and effectively matches variable time constants of the LED 
drivers. Different control settings allow this circuit to oper- 
ate either alias/transient as a dynamic operation or 
quantization/distortion as an independent operation. 

These circuits are set up to be compatible to industry 
Compact Disc standards. The encoded product having these 
variable-dynamic processes will play back with equal to or 
better sonics than without processing, even on a standard 
home player without the decoding features of the invention. 
Circuit subsystem blocks correspond to those used in pre- 
viously discussed embodiments of the invention. 

As observed in FIG. 11, "process A**, there are waveforms 
and distortion plots starting with input signal, output of 
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uncompensated encoding, the conjugate restorative 
response, and the overall corrected system response. Test 
signals include slow sweep forward from 20 Hz to 30 kHz, 
3 kHz square wave, and distortion measured from 20 Hz to 

5 30 kHz frequency sweep at near operating level. 

FIG. 12 illustrates "process B" and uses the same format 
as FIG. 12 for "process A", except the plots are for the fast 
transient process. 

One method of overcoming the frequency response limi- 

10 tation imposed on digital recording systems by industry 
standards and its effect on transient response is the use of 
slew rate compression, as discussed earlier. Slew rate lim- 
iting and expansion operate in a similar manner to the peak 
amplitude methods previously described. As before, a non- 
15 linear element is introduced in the signal path to perform the 
desired limiting, and the expansion or reconstruction method 
involves placing the same device or circuit in the feedback 
loop of an operational amplifier. Variable conduction of 
diodes with increased voltage is used for peak amplitude 

20 limiting whereas increased current through a capacitor with 
increased signal speed is used for slew rate limiting and 
expansion. Slew rate limiting takes an event and spreads it 
in time and, hence, its use must be limited to occasional 
events like those occurring in musical programs. 

25 The basic system using an analog implementation of slew 
rate compression is shown in FIG. 13. Typical waveforms 
associated with its operation are illustrated in FIG. 14. 
Schematic diagrams of the key modules are included in 
Appendix D included with this specification and are dis- 

30 cussed below, 

FIG. Dl shows an example real time slew limiter having 
a circuit configuration somewhat analogous to the diode 
limiter types previously described. Here a representative 
wideband square wave signal with transitions of many volts 

35 per microsecond is shown appUed to an amplifier, marked 
Aj, which is constructed to have a restricted slew rate 
performance of much less than one microvolt per microsec- 
ond. Its square wave output now has a well defined rise and 
fall character. When the input and output of this amplifier are 

40 compared and the gain structure is appropriately set to 
cancel slowly changing signals, the slew rate limited part of 
the signal becomes available. A bridge-like circuit of the 
amplifier A2 and the resistors Ri through Rg perform this 
task and its output is the distorted portion of the signal 

45 occurring during slew limiting. When this correction signal 
is appropriately ampfified and added to the slew limited 
signal, the original input square wave is restored. 

Avery high performance slew limiting amplifier is needed 
for this task and a specialized circuit configuration must be 

50 carefully worked out to prevent sub -harmonic, recovery, and 
overload distortions. In addition, the degree of slew rate 
Umiting with respect to signal speed must be predictable so 
that acceptable reproduction can be reconstructed when the 
correction signal is not present, as might be the case in a 

55 simple reproducer. A standard operational amplifier will not 
work adequately for this task, FIG. D2 shows a simplified 
conceptual variable slew rate amplifier where all parts 
operate in linear class A so that conduction occurs under all 
signal and limiting conditions. Voltage controlled variable 

60 current sources marked 1+ and I- are used to achieve slew 
limiting. Two of these circuit groups marked A and B oppose 
each other and the balance between them is modulated by 
the input signal through FET devices marked C and D. 
Current limits either side of balance are restricted by diodes 

65 E and F which are in turn controlled from a balanced phase 
inverter FET marked G. Slow changing signals create small 
currents through the capacitor marked H and have inconse- 
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quential effect. Large fast changing signals denaand more 
current and the limiter restrictions then restrict slew rate in 
an ever increasing manner following the diode conduction 
versus voltage curves. Hence a low distortion predictable 
and controllable symmetrical slew limit occurs. A more 
detailed schematic is shown in FIG. D3. 

In practice, it would be desirable to be able to reproduce 
an occasional fast signal such as percussive transients. These 
may have large fast transition waveshapes which are quicker 
than filter and sampling limitations allow and the above 
circuits arranged like the diode expander will perform this 
operation without requiring an external correction signal. 
FIG. D4 shows this arrangement. The variable slew ampli- 
fier is now made slower than the anticipated input signal 
from the reproducer so that the difference between the 
recorded signal limitations and the reproducer amplifier 
performance now becomes a synthesized correction signal. 
As before, Ri-Rg and amplifiers A^ and A2 are like a bridge 
which cancels imhmited signals and presents the slew rate 
difference between input and output. Previously, the limited 
and corrected signals were added to restore the input. Now 
an overcorrection is made to anticipate the signal that would 
have been at the encoder input prior to band limit filtering. 
This operation then uses an overcorrection signal which will 
vary from one signal condition to another, hence a controlled 
variable gain device, VCA, replaces the fixed R7 of the 
previous circuit. When the control signal has been properly 
set up for this event, an error correction signal can be added 
to the input signal to yield a much faster transient repro- 
duction which now more closely resembles waveshapes of 
wider bandwidth input signals. As can be seen, a transition 
shift approximating slew restoration occurs and if time 
integrity is needed, the signal must be advanced back in time 
by a variable delay so that during this reconstruction, the 
edge transition occurs where it would have in the original 
program material. 

Both slew rate and conection signal gains are controlled. 
These are analogous to curve segment shapes which might 
be stored in and recalled from lookup tables and size 
scaUngs which can be determined from examination of the 
signal. Capacitors and diodes from analog circuits create 
predictable slew dependent curve shapes and voltage con- 
trolled amplifiers respond to size information. Rate of 
change of numbers compared to some averaged nxunber 
scale and multiplier cocfBcients in memory simulating cur- 
vature or a non-linear function can do the same operations 
in the digital domain. Either operation depends on having 
first tested the record and predicted reproduce synthesis 
during encoding and then generating a control signal which 
sets up the reproducer to track the best tested results. To do 
this with the analog circuit, the input signal is lowpass 
filtered, possibly slew limited, and then compared with a yet 
lower slew rate limit circuit to get a correction signal. VCA 
gain is then adjusted to get a best match between band 
restricted and unrestricted signals. Slew limit, VCA settings, 
and engage time become the control information. Since the 
reproducer has the same circuits as those used for encoding, 
the output waveform will track. Clearly many other analog 
and digital methods to determine and synthesize slew limit 
and expand can be used. However, a unique aspect is that 
these operations can synthesize many high definition points 
of a waveshape portion from pre-coded curve shapes which 
are accessed from a low information content control signal 
or can perform a first order approximation of the waveshape 
in the absence of control. 

A presently preferred embodiment, in accordance with the 
invention, will operate primarily in the digital domain and 
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has the same very basic overall system design, as shown in 
FIGS. 3 and 4 of the drawings. As in the case of the analog 
system (e.g. FIG. 8), each subsystem is a substantially 
self-contained circuit or functional module which performs 
a unique operation. Input and output signals of these mod- 
ules are quite often similar from one design or product to 
another. Hence, if the component or subsystem added to 
improve performance does not significantly change these 
intermediate signals or the circuit configuration, then com- 
patibility to standard equipment and recordings is much 
more likely. In our case the "DSP" or digital signal process- 
ing subsystems in 100-102 and 104/105 are the unique 
elements while the remaining components of the system 
have few changes and are left as they normally appear in 
products. 

As best observed in FIG. 15, a more detailed diagram of 
the presendy preferred digital embodiment of the encode 
system, highly specialized operations are performed by 
functional groups of electronic components. Quite often, 
each performs a unique task which can be examined, 
evaluated, and described independently without involving 
other portions of the digital system. Hence, each element is 
a functional building block much like a sound system 
component which can be specified and compared to others. 

The analog input signal is applied to a balanced input 
amplifier 201 followed by a supersonic low-pass analog 
filter subsystem 202, which first isolates both signal and 
processor grounds and then removes frequencies above the 
Nyquist limit. In this manner, crosstalk between digital and 
analog signals is reduced. Audio signals must be isolated 
from digital circuits in order to prevent interaction and 
crosstalk noises. If not done effectively, these problems 
propagate throughout the audio component chain as well as 
within the encoder electronics. The supersonic filter is 
needed to eliminate high frequency components in the 
incoming signal, including radio frequency leakage and 
other noises, which would otherwise create alias and 
foldover distortions or beats when the signal is sampled. The 
output of the filter is applied to an oversampling A to D 
converter. In the embodiment shown in FIG. 15, the signal 
is sampled at 4 times the final 44.1 kiloHertz frequency. In 
another embodiment, we used a converter running at 8 times 
44.1 kHz. As part of the transient analysis described below, 
we are interested in frequencies up to at least 40 kiloHertz, 
and therefore, the filter response begins to role off above this 
region. In both cases, the cutoff frequency of the filter is well 
above the normal audio range, so that the filter can have a 
gradual roll off and not introduce audible phase distortions. 
The "brick wall" alias filter for the encoded signal is 
implemented as a digital filter in the decimation process 
described below. It is essential, however, that the response of 
the analog filter be down below the resolution limits for 
frequencies which would alias into the audible range (i.e. 
input above 132 kHz for 4-times oversampling), since these 
alias products cannot be distinguished from the program 
material or filtered out later. 

State of the art filter designs attempt to keep alias and 
foldover noises well below the resolution limits of the digital 
code. The well known Compact Disc encoding yields 16 bits 
of data sampled at 44.1 kHz. Input frequencies above 22.05 
kHz exceed the half sampling rate Nyquist limit and simply 
will not play back. Instead, one gets lower frequency dif- 
ference components which, to be inaudible, should be at 
least 85 dB down for a standard CD. However, the invention 
needs a digital signal with higher resolution, which means 
proportionately more stringent filter characteristics. Since 
we are dealing with a signal with approximately 20 bit 
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resolution, as described below, we need to keep input signals 
which would cause alias products down by at least 108 dB. 
Because of their similar noa-musical character, crosstalk 
iaterference between analog and digital processes must be at 
least as low. 

While analog filtering and isolating operations arc func- 
tionally separate operations, the required circuits are related 
and often work best when constructed together from one 
group of components. Good designs may have fully bal- 
anced push-pull signal paths, as well as separate power, 
grounding, and shielding. 

The output of the supersonic analog filter 202 is applied 
to the sample and hold and analog to digital conversion 
subsystem 203 through a summing junction in which dither 
is added. The continuous analog signals are sampled at 
regular intervals and the sample voltage held unchanging 
long enough to be converted to a binary number or word 
which represents the amplitude of the sample. As has been 
discussed previously, faster sampling rates give more points 
to define the signal waveshape and longer digital codes or 
more bits give finer resolution for each sample. Accurate 
conversion is very difficult and many clever techniques to 
achieve it are represented in commercial products. We are 
currently using a commercial hybrid integrated sample and 
hold and A to D converter which can operate at a 176.4 
kiloHertz or 4 times oversample rate and produce 18 bit 
digital words representing the sample amplitudes. This unit 
is at the limits of the current state of the art in commercially 
available converters. Prior to the availability of these 
converters, we used another commercial converter with 16 
bit accuracy at an 8 limes oversamphng rate. 

In order to get resolution in an A to D system which 
matches the capability of modern converters, great care must 
be exercised to minimize noise and analog-digital interac- 
tion. One of the techniques which we use is called silent 
conversion. In order to prevent digital interferences to 
analog signals and conversion timing, the entire logic and 
conversion system shuts down prior to the critical sampling 
operation. Noise from cables, IC's and other parts becomes 
ten to ooe hundred times less and a signal sample to accurate 
to millionth *s of a volt occurs. Once the analog signal is 
sampled and safely held, the conversion process resumes 
and the digital code is sent to the digital signal processors. 
Other systems do not work like this and are severely 
hindered by noise, crosstalk, or glitches. 

Another aspect of A to D and D to A conversion which is 
very important, as discussed earlier, is the minimization of 
sampling time jitter. Findings recently reported in the audio 
trade press indicate that a jitter of 100 picoseconds in the 
sampling time is clearly audible. In order to keep this jitter 
to a minimum, we place the system clock 209 in the A to D 
converter module. We use a clock circuit designed to have 
very low phase noise, and use a short path to the converter. 
The clock is also buffered and used to provide the master 
timing to the rest of the system. 

Oversampling, in addition to the advantages regarding 
analog filter design previously discussed, allows a given 
converter to achieve a higher amplitude resolution, or more 
bits to represent signal levels, when decimated. Each addi- 
tional bit doubles the encoded resolution to yield an almost 
6 dB greater dynamic range. In 4 times oversampling, for 
example, 4 samples arc taken for each one present in the 
final format, and those extra samples contain more infor- 
mation about the original signal. Some decimating convert- 
ers simply discard this additional information, but we con- 
vert it into amplitude resolution by using subtractive dither. 
One of the functions of the first DSP subsystem 205 is to 
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generate a dither signal, which can take one of several forms, 
including a sawtooth, a sine wave, and a pseudo-random 
noise. A process within the DSP generates small seemingly 
random numbers, which are scaled to firactional bit levels. 
5 These numbers are applied to a digital to analog converter 

207 whose output is smoothed and scaled or attenuated in 

208 to achieve fractional bit levels when added to the 
incoming analog signal. The voltage is added to the audio 
signal thereby creating a vernier effect. Within the DSP 

10 system 205, the dither numbers are delayed to match the 
system delay for samples coming from the A to D converter 
203 and the dither is subtracted out again. When the signal 
is averaged by the low pass filter process in 205 as part of 
decimation, the smallest signal components can be deter- 

15 mined to fractions of a least significant bit of the converter. 
These operations must occur at the incoming sampling 
frequency and, in the present scheme of 4 times 
oversampling, up to an extra two bits of resolution is 
possible. 

20 The digital output of the analog to digital converter is 
directed to the signal analysis subsystem 211 and through 
delay subsystem 204 to the first digital signal processing 
subsystem 205. The delay provided by 204 allows analysis 
of the signal to be made and a process control decision taken 

25 before the signal reaches the DSP system. In this way, the 
DSP is never "s\irprised" or caught off guard by changing 
signal conditions. 

In a presently preferred embodiment, the digital signal 
processing subsystem 205 is implemented using two com- 

30 mercial DSP processors with 24 bit word length and 56 bit 
acciunulators. It performs a variety of functions, including: 
generation, delay and subtraction of the dither signal, 
described above; low pass filtering the signal using a variety 
of filters; decimation of the signal to the industry standard 

35 sampling rate; and handling the transitions from one filter to 
another under the command of the process control sub- 
system 211. First, a delayed copy of the dither which was 
added to the analog signal prior to conversion is subtracted 
from the incoming digital signal. The signal then undergoes 

40 decimation, which involves low pass filtering followed by 
repeatedly discarding three samples and keeping the fourth. 
It is this digitally implemented low pass filter which per- 
forms the anti-alias function for the signal at its final 
sampling fi^equency, and, as discussed previously, no single 

45 fihcr implementation can be ideal under all program condi- 
tions because of the steep transition between the passband 
and stopband required. While a symmetrical finite impulse 
response digital filter is free of the variable group delay and 
phase distortion effects which plague analog filters, there arc 

50 still tradeoffs between alias rejection, transient response, and 
passband frequency response. The invention solves this 
problem by using different filter characteristics for different 
signal conditions, and making a smooth transition or merge 
from one filter to another. The implementation of the filters 

55 is a standard one for FIR filters using multiply and accu- 
mulate functions. The result of decimation is a signal having 
approximately 20 bit resolution at one-times sampling rate. 
This 20 bit accuracy necessitates a filter stopband rejection 
of at least 108 dB to keep alias products below the resolution 

60 of the signal. 

The output of DSP subsystem 205 is a digital signal at the 
industry standard sampling rate (44.1 kHz for CD's) having 
20 bits of information. This signal is passed to the second 
digital signal processing subsystem 210, which packs the 20 

65 bit resolution into 16 bit words matching the industry 
standard and adds control information for use by the repro- 
ducer. These operations are carried out under the command 
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of the process coatrol subsystem 211. The ioformatioo 
packing is accomplished using a digital implementation of 
the analog system described earlier. For level peaks in the 
program, an instantaneous soft limit transfer function is 
used. Since it is implemented in an exact mathematical way, s 
the transfer function can be chosen to have minimum 
audible effect for undecoded playback and can be exactly 
reconstructed in the reproduce decoder. It is also possible for 
the process control subsystem 211 to alter the limit 
parameters, such as changing the limit threshold in response 
to the degree of limiting which may already have been 
applied to the signal before it reached the encoder. In doing 
so, the controller can also send the parameter information to 
the reproducer using the control codes hidden in the signal. 

For very low level signals, an average gain compressioD 
is used to increase the system gain. This gain increase raises 
the level of those small signals further into the upper 16 bits 
of the digital word, and then the 20 bit word is rounded off 
to 16 bits, matching the industry standard format. The gain 
is controlled by subsystem 211, which looks ahead in time 
from the point of view of the DSP system 210. 211 sees an 
undclayed signal, while the DSP system gets one delayed by 
204 and 205. The control subsystem also inserts control 
codes which tell the reproducer what it has done with the 
gain. The second DSP subsystem is also used to apply 
"dynamic dither" or noise shaping as discussed above in the ^ 
analog description. 

The final task of the DSP system 210 is to encrypt and 
insert the control codes into the least significant bit of the 
digital words. The details of this process are discussed later. 
These are the codes which tell the decoder what has been 
done to the signal, so that it can carry out complementary 
processes. 

Both DSP subsystems receive commands from the signal 
analysis and process control subsystem 211. This module 
receives the oversampled digital signal directly from the A 
to D converter, conditions it, analyzes it, and based on the 
analysis, makes process control decisions and sends com- 
mands to the DSP modules. It also generates the control 
codes for the reproducer which are included in the encoder 
output. The modiile uses digital versions of the analog ^° 
algorithms discussed earlier: 

It uses ratios of high frequency content to total ampUtude 
along with detected isolated transients to select filter 
programs for the decimation filter. 
It measures the average signal level of the broad middle 
frequency spectrum and uses the results to control the 
gain of the low level compressor. It also generates 
reproducer control codes to correctly complement the 
encode gain structure. 
It measures the average level of low level high frequency 
signals, and invokes dynamic dither insertion of extra 
high frequencies when appropriate. 
It analyzes the distribution of peak amplitudes to deter- 
mine if the incoming signal has been limited prior to the 55 
encoder. If so, it can raise the threshold of the encoder's 
soft limit function, or turn it off altogether. 
It can compare the decimated signal to the oversampled 
one delayed to match the decimation to look for iso- 
lated bursts of high firequency information which rep- 60 
resent transients which would not fit within the normal 
22 kiloHertz bandwidth. These difference signals can 
be sent to the reproducer in the control channel, ^read 
in time, so that the reproducer can correct the transient 
on playbadc. 65 
It can also use the transient analysis to control slew rate 
limiting of the main signal as an alternate approach to 
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increasing the apparent bandwidth of the system, as 
previously discussed. 

It controls the insertion of hidden codes in the least 
significant bit of the encoded signal, putting them in 
when needed and letting the LSB be used for the main 
signal when it is not needed for control. 

The process control subsystem is the nerve center of the 
encoder, making the decisions and controlling the functions 
of the DSP units. It is not necessary for a given implemen- 
tation to incorporate all of the features above. For economic 
reasons, it may be desirable to only include a particular 
subset. Since the encoder uses control codes to tell the 
reproducer what it is doing, a more capable reproducer will 
not be confused, and a less capable one will ignore those 
functions that it cannot complement. 

The digital data output from the second DSP module 210 
goes to the format converter and then to the recorder. 
Compact Disc, digital audio tape, etc. operate on similar 
encoding principles. However, these systems have different 
recorded formats and electronic signals for the same 16 bits 
of encoded program data. In the industry standard format 
conversion subsystem 212, specialized IC chips are config- 
ured to add program track information and other housekeep- 
ing information to the data and combine the two channels of 
16 bit program digital data into a single data stream which 
has been configured to industry standard formats. The end 
result is a combined data and operational code made com- 
patible with the input of a standard digital recorder. This 
module performs functions common to all digital recording 
systems, and uses commercially available special function 
integrated circuits to perform the format conversions. 

As best observed in FIG. 16, a more detailed diagram of 
the presently preferred digital embodiment of the decode 
system, highly specialized operations are performed by 
functional groups of electronic components. In the playback 
subsystem, the first element of the reproduce chain could be 
a video player, CD player, receiver or other equipment. 
These components usually have servos, conversions from 
specialized standards, buffer memories, and occasionally 
phase or frequency locked timing systems to achieve stable 
continuous playback signals. For example, such a system 
could be a CD transport. Each type of digital system requires 
its unique unscrambling, patching, and fixing operations to 
eventually extract "error free" program digital data and this 
is accomphshed by standard circuitry within the player or 
other device. The output of the player is a stream of digital 
data in one of several industry standard formats, and this 
stream of data forms the input to our decode system. 

Referring to FIG. 16, the data from the reproducer is 
apphed to a format converter 220, in which one of the 
industry standard serial digital data formats is converted into 
a form suitable for use internally within the decoder. The 
data is normally split into right and left channels at this point 
for separate processing. This format conversion is carried 
out Tising commercially available integrated circuits 
designed for this function. This subsystem also may provide 
servo feedback control to the transport to control the incom- 
ing data rate, and it provides timing information to the 
decoder system clock. 

The data output of the format converter goes to the control 
decode module 221. This subsystem is complementary to the 
process control subsystem 211 in the encoder. Its functions 
include detecting and decoding the hidden control codes 
inserted by the encoder, possible code stripping or removal 
of the code fi^om the signal, signal analysis of the data signal, 
and generation of process control signals to control the DSP 
modules based on the nature of the signal and the hidden 
codes. 
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The data signal then goes to delay module 222, which tightly coupled to the converter module. Ihe analog output 

gives the control decode module 221 time to figure out what goes to the supersonic filter. 

to do with the signal before it gets to the first DSP subsystem In the analog smoothing filter subsystem 227 and output 

223. The first DSP module 223 is the complement to module buffer ampHfier subsystem 228, final rounding and removal 

210 in the encoder. It does a peak expansion which restores S of supersonic signals occurs with an analog low pass filter 

the peaks Umited in 210. It does a low level gain expansion, ^o°g amplification to standard fine levels and output 

restoring the low level dynamics compressed in 210. It can impedance. A sophisticated design such as ours treats the 

complement the low level forcing of high frequencies in the digital filtering as a whole system to achieve the 

dynamic dither operation, restoring a flat frequency response ^^""^^^ both methods offer. As m the encoder the isolaUon 

and lowering quantization noise. It performs some house- lO ?^ f"^''^] analog processes :s achieved through fiiUy 

keeping frinctions, and its signal output has 18 to 20 bits of '""^ ^y^T"' ^"""^"l 

1 • c .,1. >• 1- . 1 . IT r supplies, and isolated grounding schemes which prevent 

real infonnation at the one-tunes samphng rate (44.1 kHz for i^J^^action with cables and other external components. The 

J:. , result is a line level analog output signal. This completes the 

Tills more accurate digital signal at the media samphng description of the signal path from the analog input of the 

rate is routed to the second digital signal processor sub- is encoder to the analog output of the decoder, 

system 224, which is complementary to encode module 205. The following is a description of the control channel in the 

In this subsystem, the signal is interpolated to a higher presently preferred embodiment which allows us to send 

samphng rate using a variety of smoothing filters which are control commands and auxiliary signal information from the 

chosen to complement the decimation filters in 205. encoder to the decoder in the same signal as the main 

All D to A conversion systems involve a smoothing 20 program, 

operation to convert the discreet sampled signal back to a The command codes and other auxiliary data are 

continuous analog waveform. Digital interpolation is fre- encrypted with a pseudo-random noise and inserted into the 

quently used to increase the sampling rate by calculating a least significant bit of the main signal digital words in a 

larger number of steps representing the continuous wave- serial fashion, one bit per word. The LSB of the audio is 

form. A larger number of smaller amplitude steps reduces is replaced by a "random" ooise for the duration of the control 

the burden placed on the analog smoothing filter 227 fol- insertion. (Of course, more than one bit could be "borrowed" 

lowing the conversion back to analog form. Most player for this purpose, but more of the main program would be 

circuits employ some version of this technique. Again an lost.) The system is set up so that when the control channel 

"oversampling*' has occurred. However, in a normal player, is not needed, the LSB carries the normal audio signal. Since 

the information content between input and output from 30 the digital to analog converters in most of the current 

interpolation has not changed since the filter cannot create generation of digital audio products are not accurate to 16 

new information from its curve fitting computations. By bits, the loss of the 16th bit wiU not be audible during 

contrast, our interpolation subsystem has knowledge of the undecoded playback, as long as the information inserted 

signal resulting from an analysis made in the encoder prior there has noise-fike properties. Even in high quality systems 

to the bandwidth Hmiting decimation. This information has 35 which do resolve all 16 bits, the insertion is not normally 

been sent to it through the control channel in the form of audible because the LSB of most programs already has very 

filter selection control, and transient correction or enhance- noise-like properties. The low level gain compression and 

ment data, and thus this interpolator can restore some of the dynamic dither described previously raise the level of the 

information deleted by the decimator. program during very quiet periods and help hide the code 

The decode system can also provide some improvement 40 insertions during those program conditions under which they 

to playback of standard unencoded signals by analyzing the might be noticeable. In typical classical music 

incoming signal characteristics in module 221 and using the programming, the control signal would be inserted for 

results to pick a smoothing filter which is probably best This intervals of about a millisecond each occurring several times 

single ended operation results in an improvement over a per second at most. The loss of fiill program resolution for 

conventional player, but it cannot achieve the performance 45 these brief intervals is not noticeable, 

of the full system. Circuits to create random noise, modulate a control signal. 

The smoothing or interpolation filters in DSP subsystem insert it in the LSB of the data stream and then retrieve and 

224 are standard finite impulse response or FIR types, which decode it have been assembled and made to initiate filter 

are made symmetrical to avoid phase distortions. The sub- selection from a hidden control signal. These circuits arc 

system must implement smooth transitions or merge opera- 50 included in Appendix B. 

tions from one interpolation filter to another in the same The process control signal is hidden in the least significant 
manner as the decimator does. It may also include transient bit of the digital audio channel by modulating it with a noise 
synthesis and slew rate modification, similar to the analog signal. Our circuit consists of a pseudo -random noise gen- 
implementation discussed earlier. erator based on a shift register with feedback which imple- 

In summary, the first decoder DSP module 223 restores 5S ments a maximal length sequence. This type of generator 

ampHtude resolution, and tbe second DSP module 224 produces a deterministic sequence of bits which sounds very 

restores frequency or transient resolution. Both of these random, and yet is a reproducible sequence. The output of 

operations arc the complements of operations in the encoder. the noise generator is added to the control signal modulo- 

The high resolution oversampled signal goes to the digital two (exclusive-or'ed), modulating the signal with noise, or 

to analog converter subsystem 225. As in the encoder, wc 60 scrambling it. The result is then inserted into the least 

use a commercially available D to A converter module significant bit of the record serial data stream. On the play 

which represents the current state of the art. The current side, the least significant bit is extracted from the serial 

embodiment uses 20 bit converters operating at 4 times digital stream and the output of a matching shift register is 

oversampling. We have also used 18 bit converters at 8 times subtracted from it, modulo-two (cxclusive-or again). The 

oversampling. As in the encoder, great care must be taken to 65 result is the process control signal, unscrambled again, 

isolate the analog signal from the digital noise, and sample There are two basic variations of this scheme. The first 

timing jitter is minimized by using a low noise master clock version uses two noise generators, one on the record side and 
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one on the play side. The record generator noise is added to 
the signal, and the play generator noise is subtracted. If the 
two generators produce the same bit sequence, the original 
signal is recovered. The problem is that the play generator 
must be synchronized with the noise sequence added during 
record. While there are many well-known approaches to 
solving this problem which are covered in the literature on 
spread spectrum communications, it is still a non-trivial 
problem. Although this approach is feasible, a presently 
preferred embodiment of the system employs the following 
technology. 

In the preferred embodiment, the sum of the process 
control signal and the generator output is fed back to the 
generator input. This effectively "folds" the signal into the 
generator sequence so that the scrambled signal depends 
only on the recent history of the bits, and the play side 
contains a matching shift register with no feedback. Because 
the play side only uses "feed- forward'* addition of the bits in 
the shift register, it is guaranteed to become synchronized as 
soon as N+1 bits have arrived, where N is the length of the 
shift register. The disadvantage of this approach is that it is 
possible for the noise generator to become stuck temporarily, 
depending on the characteristics of the process control 
signal. The probability of this happening can be made 
arbitrarily small by increasing the length of the shift regis- 
ters. In the implementation shown in Appendix B, which 
uses a 17 bit shift register, the probability is on the order of 
1 in 100,000 that a bit sequence might occur which coidd 
cause the generator to stick. By going to a 31 bit shift 
register, the probability drops to about 1 in 2 billion, which 
corresponds to once every 12.6 hours for a CD. If the 
process control signal is changing rapidly, the artifact of a 
"stuck** noise generator will be of short enough duration to 
be noise-like and inaudible. The problem of a stuck noise 
generator is only relevant if the control sequence is inserted 
continuously. In the preferred embodiment, in which the 
control is only inserted for brief intervals, it is not a problem 
for two reasons. First, since the LSB is returned to the 
program signal most of the time, the stuck generator output 
is not inserted into the signal. Secondly, dynamic insertion 
requires the use of a synchronizing sequence, as described 
below, which can be designed to guarantee that the generator 
does not get stuck. 

Dynamic insertion of the control signal into the LSB or 
sharing the LSB with the main program data means that the 
reproducer has to be able to identify the commands embed- 
ded within the stream of arbitrary main program data. This 
is accomplished by preceding a command code with a 
synchronizing sequence of bits which the decoder looks for 
in the data stream. The sequence can be made long enough 
that the probability of its occurrence in the program data is 
extremely small, assxmiing that the program data is essen- 
tially random. Of course, one must avoid patterns that might 
appear with more than random frequency, such as long 
strings of ones or zeros which could occur during silent 
periods in the program. False triggering of the reproducer on 
program data can be completely eliminated on recordings 
incorporating the invention by having the encoder monitor 
the program data stream during recording and alter the least 
significant bit in one word if the synchronizing sequence is 
about to occur, thereby preventing it. This results in a bit 
error probability on the same order as the prevented false 
trigger probabihty, which can be made much less disruptive 
than the insertion of control codes, and so inconsequential. 

It should be noted, that the aforedescribed technique can 
be used to hide arbitrary digital data in a digital audio signal 
or other digital signal representing analog data in which 
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accuracy to the least significant bit is not continuously 
necessary. Such data inserted in place of or in addition to our 
process control signal could be used to control a multi-media 
presentation or for some other completely unrelated pur- 
5 pose. 

It wiU be apparent from the foregoing description that 
those of ordinary skill in the audio, digital and data pro- 
cessing arts should be able to utilize a wide variety of 
computer and other electronic implementations in both 
hardware and software to practice many of the analysis, 
evaluation, encoding, decoding and compensation tech- 
niques embodied within the methods and apparatus of the 
present invention. 

The aforedescribed systems of the present invention sat- 

j5 isfy a long existing need in the art by providing new and 
improved digital encoding/decoding methods and apparatus 
for ultra low distortion reproduction of analog signals and 
which are also compatible with industry standardized signal 
playback apparatus not incorporating the decoding features 

2Q of the present invention. In addition, signals lacking the 
encoding process features of the invention are likewise 
compatible with playback decoders which do embody the 
invention and are provided some overall enhancement. 
The present invention provides an improved encode/ 

25 decode system enabling a predetermined balance or inter- 
play of gain, slew and wave synthesis operations to reduce 
signal distortions and improve apparent resolution. Analysis 
is made of waveform characteristics during the encoding 
process, and the results of this analysis are subsequently 

3Q utilized in the decoding process to more accurately recon- 
struct the original waveform, while minimizing the delete- 
rious effects normally encountered in sampling and convert- 
ing analog signals to digital signals and subsequently 
reconverting the digital signals back to an accurate simula- 

35 tion of the original analog waveform. 

In accordance with the invention, control information 
developed during the aforedescribed waveform analysis is 
concealed within a standard digital code and this informa- 
tion is subsequently used to dynamically change and control 
the reproduction process for best performance. These con- 
cealed control codes trigger appropriate decoding signal 
reconstruction compensation complementing the encoding 
process resulting firom the signal analysis. Since the control 
code is silent and the overall digital information rate is 

45 normally fixed, the process can operate compatibly with 
existing equipment and to manufacturer's specifications and 
standards. In addition, and as previously indicated, signals 
lacking the encoding process features of the invention are 
likewise compatible with playback decoders which do 

5Q embody the invention and are afforded some beneficial 
enhancement. 

It will be apparent from the foregoing that, while particu- 
lar forms and several aspects of the invention have been 
illustrated and described, various modifications can be made 
55 without departing from the spirit and scope of the invention. 
Accordingly, it is not intended that the invention be limited, 
except as by the appended claims. 

We claim: 

1. A method for converting and encoding an analog signal 
go to a digital format and subsequently decoding and convert- 
ing said digital format to recover the analog signal, com- 
prising the steps of: 

monitoring the physical characteristics of an analog wave- 
form to be converted to a digital format; 
65 converting said analog waveform to said digital format; 
encoding within said digital format control infonnation 
indicative of the physical characteristics of said analog 
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waveform, whereby said analog waveform can subse- 
quently be more accurately reconstructed from said 
digital format; 

decoding from said digital format said control information 
indicative of certain specified physical characteristics ^ 
of said analog waveform; 

converting said digital format signal to said analog wave- 
form; and 

peak limiting and restoring; and 

introducing compatible signal reconstruction 
compensation, in accordance with said control infor- 
mation during said converting process, said informa- 
tion facilitating subsequent more accurate reconstruc- 
tion of said analog waveform from said digital format. 15 

2. A method as set forth in claim 1, wherein said infor- 
mation indicative of the physical characteristics of said 
analog waveform is cncripted within said digital format. 

3. A method as set forth in claim 1, wherein said infor- 
mation indicative of the physical characteristics of said 20 
analog waveform is concealed within said digital format. 

4. A method as set forth in any of claims 1, 2 or 3, wherein 
said control information is encripted to the least significant 
bits of said digital format. 

5. A method as set forth in claim 4, wherein said control 25 
information is in the form of control codes. 

6. A method as set forth in claim 1, wherein said peak 
limiting and restoring includes an encoder selected algo- 
rithm for decoding. 

7. A method as set forth in claim 1, wherein said peak 30 
limiting and restoring includes one-to-one mapping for 
reconstruction by a decoder. 

8. A method as set forth in claim 1, wherein said peak 
limiting and restoring includes use only at highest peak 
levels. 35 

9. A method as set forth in claim 1, wherein said peak 
limiting and restoring includes mimicking analog tape satu- 
ration curve shape for low distortion in un-decoded play- 
back. 

10. A system for converting and encoding analog signals 
to a digital format, comprising: 
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means for monitoring the physical characteristics of an 
analog waveform to be converted to a digital format; 

means for converting said analog waveform to said digital 
format; 

limiting means for peak limiting said digital format; 
means for selectively activating said limiting means; and 
means for encoding within said digital format information 
indicative of the physical characteristics of said analog 
waveform, to facilitate subsequent more accurate 
reconstruction of said analog waveform from said 
digital format. 

11. A system as set forth in claim 10, and further including 
limiting means for peak limiting said digital format; and 
means for selectively actively said limiting means. 

12. A system as set forth in claim 10, wherein said 
information indicative of the physical characteristics of said 
analog waveform is encripted within said digital formal. 

13. A system as set forth in claim 10, wherein said 
information indicative of the physical characteristics of said 
analog waveform is concealed within said digital format. 

14. A system as set forth in claim 10, wherein said 
information is encripted to the least significant bits of said 
digital format. 

15. A system as set forth in claim 10, wherein said 
information is in the form of control codes. 

16. A system as set forth in claim 10, wherein said digital 
format represents a compressed signal to be complementary 
expanded by a subsequent decoder. 

17. A system as set forth in any of claims 10 through 16, 
wherein said information relates to slew correction. 

18. A system as set forth in any of claims 10 through 16, 
wherein said information relates to level correction. 

19. A system as set forth in any of claims 10 through 16, 
wherein said information relates to waveform synthesis. 

20. A system as set forth in any of claims 10 through 16, 
wherein said information relates to level, slew and corrective 
waveform synthesis, 

* « « « * 
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CERTIFICATE OF CORRECTION 

PATENT NO. : 5,872,531 
DATED : Feb, 16, 1999 

INVENTOR(S) : Keith O, Johnson, Michael W. Pflaumer 

It is certified that error appears In the above-identified patent and that said Letters Patent Is hereby 
corrected as shown below: 



Column 10, line 25, after "5e", add — (5e-l through 5e-5) — * 

Column 10, line 31, after "7a", add — (7a-l through 7a-4) — , 
also after ^'7d", add — (7d-l through 7d-4) — . 

Column 18, line 49, change "FIG. 7b", to read — FIG. 7b-l 
through 7b-4 — . 

Column 18, line 59, change "FIG. 7c", to read — FIG. 7c-l 
through 7c-4 — . 

Column 18, line 68, change "FIG. 7d", to read — FIG. 7d-l 
through 7d-4 — . 

Column 48, lines 12-14, delete claim 11 in its entirety. 
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